CN103365621B - Image processing method and device - Google Patents
Image processing method and device Download PDFInfo
- Publication number
- CN103365621B CN103365621B CN201310268258.5A CN201310268258A CN103365621B CN 103365621 B CN103365621 B CN 103365621B CN 201310268258 A CN201310268258 A CN 201310268258A CN 103365621 B CN103365621 B CN 103365621B
- Authority
- CN
- China
- Prior art keywords
- screen
- target screen
- auxiliary storage
- display data
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a kind of image processing method and device.Described method includes step: instruct the data render being provided the application program of local runtime to auxiliary storage according to current split screen；According to current split screen instruction, display data corresponding in described auxiliary storage are sent to corresponding target screen；And the input by each target screen is mapped to described auxiliary storage.Methods and apparatus of the present invention instructs according to split screen and display data corresponding in auxiliary storage is separately sent to corresponding target screen, and the input on each target screen is remapped to auxiliary storage, when making to use the method and device of the embodiment of the present invention to carry out multi-screen interactive, in addition to main equipment, do not require the compatibility to application program for the miscellaneous equipment, it also avoid the exploitation running into multi-screen application Overpassing Platform by Using between heterogeneous device, customized development, application is issued, is safeguarded and upgrading, the difficulty of the aspects such as user authentication.
Description
Technical field
The present invention relates to technical field of image processing, particularly relate to a kind of many image processing methods and
Device.
Background technology
The concept of Multiple-screen integration interaction in recent years is progressively popularized, Multiple-screen integration interaction technique
Development has expedited the emergence of a lot of new application scenarios, for example: uses mobile phone remote intelligent television, pass through
The display content etc. of panel computer play by TV.Between multi-screen same aobvious, collaborative, alternately with
It and virtualization disclosure satisfy that multiple daily Digital Life demand, is increasingly subject to the welcome of user,
Interactive in order to realize Multiple-screen integration, usually require that can run on heterogeneous device can be real on multi-screen
Now mutual same application program and the application program of same version, but multi-screen application open
Send out exist at aspects such as the display of heterogeneous device, communication, operating system and development platforms many
Difficulty, the development speed of multi-screen application is also therefore relatively slowly.
Content of the invention
The technical problem to be solved in the present invention is: provide a kind of image processing method and device, energy
Enough avoid meeting with the display at heterogeneous device for the multi-screen application and development, communication, operating system and
Realize on the premise of the aspects such as development platform difficult that Multiple-screen integration is interactive.
For solving above-mentioned technical problem, first aspect, embodiments provide a kind of image
Processing method, described method includes step:
Instruct the data render that the application program of local runtime is provided according to current split screen
To auxiliary storage；
It is right to send in described auxiliary storage to corresponding target screen according to current split screen instruction
The display data answered；And
The display of each target screen is exported and interactively enters and is mapped to described auxiliary storage.
In conjunction with first aspect, in the first possible embodiment, described method also includes step
Rapid:
Receive split screen instruction；
Auxiliary storage is set up in split screen instruction according to receiving.
In conjunction with the first possible embodiment of first aspect, the possible embodiment party of the second
In formula, the instruction of described split screen includes the resolution ratio of each target screen；
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Set up auxiliary storage according to the resolution ratio of described each target screen.
In conjunction with the first possible embodiment of first aspect, the third possible embodiment party
In formula, the instruction of described split screen includes the corresponding relation showing data and each target screen；
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Set up auxiliary storage according to the corresponding relation of described display data and each target screen.
In conjunction with the first possible embodiment of first aspect, the 4th kind of possible embodiment party
In formula, the instruction of described split screen includes the resolution ratio of each target screen and shows data and each target screen
Corresponding relation；
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Resolution ratio according to described each target screen and display data pass corresponding with each target screen
System sets up auxiliary storage.
In conjunction with any of the above-described kind of possible embodiment of first aspect or first aspect, the 5th
Planting in possible embodiment, the instruction of described split screen includes the resolution ratio of each target screen and shows
Registration according to the corresponding relation of each target screen, and the resolution ratio of described each target screen and display number
Inputted by user according to the corresponding relation with each target screen and/or obtain from this locality.
In conjunction with first aspect, in the 6th kind of possible embodiment, current the dividing of described basis
The data render that the application program of local runtime is provided by screen instruction is to the step of auxiliary storage
Suddenly include:
The data render being provided the application program of local runtime is to auxiliary storage；And
Set up the mapping relations between described auxiliary storage and the main storage area of each target screen.
In conjunction with first aspect, in the 7th kind of possible embodiment, bag in the instruction of described split screen
Include the corresponding relation of display data and each target screen；
The current split screen instruction of described basis sends described auxiliary storage to corresponding target screen
The step of interior corresponding display data screen includes:
According to the corresponding relation of display data and each target screen, choose corresponding display data；
Described corresponding display data are processed；
Display data after corresponding target screen transmission is processed.
In conjunction with the 7th kind of possible embodiment of first aspect, the 8th kind of possible embodiment party
In formula, the instruction of described split screen includes the resolution ratio of each target screen；
The described step processing described corresponding display data includes:
The resolution ratio of the resolution adjustment corresponding display data according to target screen.
In conjunction with the 6th kind of possible embodiment of first aspect, the 19th possible embodiment party
In formula, described main storage area is for storing the display data of the display corresponding to target screen.
In conjunction with first aspect, in the tenth kind of possible embodiment, described auxiliary storage is used
In the read-write operation object as local application.
In conjunction with any of the above-described kind of possible embodiment of first aspect, possible at the 11st kind
In embodiment, described target screen includes locally displayed screen.
Second aspect, embodiments provides a kind of image processing apparatus, described device bag
Include:
Rendering module, for being carried the application program of local runtime according to current split screen instruction
The data render of confession is to auxiliary storage；
Processing module, for sending described auxiliary according to current split screen instruction to corresponding target screen
Corresponding display data in helping memory block；And
Input remaps module, is mapped to for exporting and interactively entering the display of each target screen
Described auxiliary storage.
In conjunction with second aspect, in the first possible embodiment, described device also includes:
Receiver module, is used for receiving split screen instruction；
Module is set up in auxiliary storage, for the split screen instruction receiving according to described receiver module
Set up auxiliary storage.
In conjunction with the first possible embodiment of second aspect, the possible embodiment party of the second
In formula, the instruction of described split screen includes the resolution ratio of each target screen；
Described auxiliary storage is set up module and is set up auxiliary according to the resolution ratio of described each target screen
Memory block.
In conjunction with the first possible embodiment of second aspect, the third possible embodiment party
In formula, the instruction of described split screen includes the corresponding relation showing data and each target screen；
It is corresponding with each target screen according to described display data that module is set up in described auxiliary storage
Relation sets up auxiliary storage.
In conjunction with the first possible embodiment of second aspect, the 4th kind of possible embodiment party
In formula, the instruction of described split screen includes the resolution ratio of each target screen and shows data and each target screen
Corresponding relation；
Module is set up according to the resolution ratio of described each target screen and display number in described auxiliary storage
Set up auxiliary storage according to the corresponding relation with each target screen.
In conjunction with any of the above-described kind of possible embodiment of second aspect or second aspect, the 5th
Planting in possible embodiment, the instruction of described split screen includes the resolution ratio of each target screen and shows
Registration according to the corresponding relation of each target screen, and the resolution ratio of described each target screen and display number
Inputted by user according to the corresponding relation with each target screen and/or obtain from this locality.
In conjunction with second aspect, in the 6th kind of possible embodiment, described rendering module includes:
Rendering unit, the data render being used for being provided the application program of local runtime is to auxiliary
Memory block；And
Output map unit, for setting up the main storage area of described auxiliary storage and each target screen
Between mapping relations.
In conjunction with second aspect, in the 7th kind of possible embodiment, bag in the instruction of described split screen
Include the corresponding relation of display data and each target screen；
Described processing module includes:
Data selecting unit, for according to display data and the corresponding relation of each target screen, choosing
Corresponding display data；
Processing unit, for processing to described corresponding display data；
Transmitting element, for the display data after corresponding target screen transmission process.
In conjunction with the 7th kind of possible embodiment of second aspect, the 8th kind of possible embodiment party
In formula, the instruction of described split screen includes the resolution ratio of each target screen；
Described processing unit is according to the resolution of the resolution adjustment corresponding display data of target screen
Rate.
In conjunction with the 6th kind of possible embodiment of second aspect, the 9th kind of possible embodiment party
In formula, described main storage area is for storing the display data of the display corresponding to target screen.
In conjunction with second aspect, in the tenth kind of possible embodiment, described auxiliary storage is used
In the read-write operation object as local application.
In conjunction with any of the above-described kind of possible embodiment of second aspect, possible at the 11st kind
In embodiment, described target screen includes locally displayed screen.
Methods and apparatus of the present invention instructs according to split screen and shows in auxiliary storage accordingly
Data are separately sent to corresponding target screen, and are remapped to auxiliary by the input on each target screen
Help memory block so that when using the method for the embodiment of the present invention to carry out multi-screen interactive, remove main equipment
Outward, it is not required that the compatibility to application program for the miscellaneous equipment, it also avoid run into multi-screen application open
Sending out Overpassing Platform by Using between heterogeneous device, customized development, application is issued, is safeguarded and upgrading,
The difficulty of the aspects such as user authentication.
Brief description
Fig. 1 is the flow chart of the image processing method of the embodiment of the present invention；
Fig. 2 is a kind of structural representation of the image processing apparatus of the embodiment of the present invention；
Fig. 3 is the application scenarios signal of an example of the image processing method of the embodiment of the present invention
Figure；
Fig. 4 is the flow chart of an example of the image processing method of the embodiment of the present invention；
Fig. 5 be the image processing method of the embodiment of the present invention an example in auxiliary storage
Distribution schematic diagram；
Fig. 6 is the another kind of structural representation of the image processing apparatus of the embodiment of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawings and embodiment, the detailed description of the invention of the present invention is made further in detail
Explanation.Following example are used for illustrating the present invention, but are not limited to the scope of the present invention.
In order to be better understood from various embodiments of the present invention, show used in various embodiments of the present invention
Term do following explanation:
Main equipment, also referred to as local device, for running application program in various embodiments of the present invention
Equipment.
Target device, for the equipment needing display part main equipment display content according to user.
Main equipment and target device can have display and the fixing of disposal ability or can move for any
Dynamic equipment, for example: computer, portable notebook computer, mobile phone, panel computer, TV,
Mobile unit and Wearable device etc..When as target device, this equipment is permissible
Not there is any disposal ability.
Main storage area, each equipment has master in (including main equipment and each target device)
Memory block, the display data of the display corresponding to the display screen of each equipment for the storage.
Auxiliary storage, is used for the right of the read-write operation as local (main equipment) application program
As it may be located at the optional position in master system memory (internal memory), it is possible to is positioned at
Main equipment extended menory (such as hard disk, the mobile memory space being connected by USB interface
Etc.) in optional position, on main equipment run application program directly right under graphic model
This auxiliary storage is written and read operation.
In various embodiments of the present invention, the data that on main equipment, operation application program is provided are by wash with watercolours
Dye arrives auxiliary storage, and the read-write object of application program is this auxiliary storage, is rendered into auxiliary
Display data after memory block as the storage content in the main storage area of main equipment, main equipment
The display of display screen is corresponding to the display data of storage in main storage area, the display on each target screen
The display of screen is corresponding to the display data of storage in the primary storage of each target screen.In other words, user
The content seen on the display screen of each equipment is corresponding to storage in the main storage area of each equipment
Display data, and the content that application program is read and write is the content of the auxiliary storage of main equipment.
As it is shown in figure 1, the image processing method of the embodiment of the present invention includes step:
S101. instruct, according to current split screen, the number that the application program of local runtime is provided
According to being rendered into auxiliary storage.
In the method for the embodiment of the present invention, split screen instruction is alternatively referred to as multi-screen parameter and arranges, excellent
Selection of land includes: split screen trigger command, the resolution ratio of each target screen and display data and each target
The corresponding relation of screen, split screen instruction can be simultaneously entered and sequentially input also dependent on needs.Split screen touches
Saying the word and referring to come into effect the order of split screen, this order can be touch-control order, voice command etc..
Corresponding to different target screen display data can all identical, part is identical, can entirely not yet
Identical.It should be noted that in the method for the embodiment of the present invention, target screen also includes main setting
Standby display screen.
S102. send out to corresponding target screen with the form of video flowing according to current split screen instruction
Corresponding display data in sending described auxiliary storage.
Complete data render that application program is provided to behind auxiliary storage, according to display
Display deblocking in auxiliary storage is processed simultaneously by data with the corresponding relation of each target screen
Sending corresponding video flowing, so, the video flowing receiving is stored in this locality by each target device
Main storage area in, for the display of locally displayed screen.
S103. the display of each target screen is exported and interactively enter and be mapped to described auxiliary storage
District.
After completing split screen display available, the method for the embodiment of the present invention is by defeated for the display on arbitrary target screen
Go out and interactively enter the auxiliary storage being remapped to main equipment, reading for application program, from
And realize application program run on main equipment, be shown in multiple equipment while, moreover it is possible to leading
The process mutual to the user in arbitrary equipment is realized on equipment.
To sum up, the method for the embodiment of the present invention instructs corresponding in auxiliary storage according to split screen
Display data are separately sent to corresponding target screen, and remap the input on each target screen
To auxiliary storage so that when using the method for the embodiment of the present invention to carry out multi-screen interactive, except master
Outside equipment, it is not required that the compatibility to application program for the miscellaneous equipment, it also avoid and run into multi-screen application
Exploitation between heterogeneous device Overpassing Platform by Using, customized development, application issue, safeguard and rise
Level, the difficulty of the aspects such as user authentication.
In the method for the embodiment of the present invention, split screen instruction can be user's input or previous from this locality
Setting in read, it is possible to for user's input and locally stored previously positioned combination.Auxiliary
Help memory block can be original frame buffer (for example: rearmounted caching (back buffer)) on main equipment,
The storage region being alternatively response split screen instruction and again choosing.Now, the embodiment of the present invention
Method also includes:
S001. split screen instruction is received；
S002. auxiliary storage is set up according to the split screen instruction receiving.
Additionally, in the method for the embodiment of the present invention, can be according to the display quality etc. to target screen
Demand be set adaptively the resolution ratio of auxiliary storage and (include dividing original frame buffer
The setting of the size in the adjustment of resolution and the storage region again chosen).For example: according to respectively
The resolution ratio of target screen sets up auxiliary storage, to realize the display of first water on target screen；
Or set up auxiliary storage according to the corresponding relation of display data and each target screen；Certainly, it is possible to
Set up in conjunction with the resolution ratio of each target screen and the corresponding relation of display data and each target screen
Auxiliary storage.For failing to adjust when rendering to auxiliary storage to optimum resolution ratio
Situation, can send to the adjustment that carry out resolution ratio before or after target screen, it is possible to do not enter
Row adjusts.
In order to perform exactly this split screen instruct and realize application program to user in each target
Mutual accurate response on screen, the method for the embodiment of the present invention needs to set up the master of each target screen
Mapping relations between memory block and the auxiliary storage of main equipment.Tool speech, real in the present invention
Executing in the method for example, step S101 includes:
S1011. the data render being provided the application program of local runtime is to auxiliary storage；
S1012. the mapping between described auxiliary storage and the main storage area of each target screen is set up
Relation.
In the method for the embodiment of the present invention, step S102 includes:
S1021. according to display data and the corresponding relation of each target screen, sequentially or simultaneously choose
Each target screen corresponding display data.
S1022. the process such as coding are compressed to described corresponding display data and form video flowing.
It should be noted that for the display realizing optimum quality on target screen, in this step
In can be according to the resolution ratio of the resolution adjustment of target screen video flowing to be sent, it is possible at video
Stream is carried out the adjustment of resolution ratio by target screen in its this locality after being sent to target screen.
S1023. the video flowing obtaining after corresponding target screen transmission is processed.
To sum up, the method for the embodiment of the present invention keeps applying any single screen by auxiliary storage
Compatibility to existing equipment；By auxiliary storage self adaptation, resolution ratio is set at multi-screen isomery screen
High-quality display is provided on curtain；Content by video flowing transmission multihead display is various different with compatibility
Structure equipment；Additionally, main equipment can be set by main by user's interactive controlling display content and ratio
Remap with mutual for carrying out display, and then determine actual mutual position to realize exactly
Multiple-screen integration is mutual.
As in figure 2 it is shown, the image processing apparatus 200 of the embodiment of the present invention includes:
Rendering module 201, for instructing the application program of local runtime according to current split screen
The data render being provided is to auxiliary storage.
In the device of the embodiment of the present invention, split screen instruction is alternatively referred to as multi-screen parameter and arranges, excellent
Selection of land includes: split screen trigger command, the resolution ratio of each target screen and display data and each target
The corresponding relation of screen, split screen instruction can be simultaneously entered and sequentially input also dependent on needs.Split screen touches
Saying the word and referring to come into effect the order of split screen, this order can be touch-control order, voice command etc..
Corresponding to different target screen display data can all identical, part is identical, can entirely not yet
Identical.It should be noted that in the device of the embodiment of the present invention, target screen also includes main setting
Standby display screen.
Processing module 202, for according to current split screen instruction with the form of video flowing to accordingly
Target screen send described auxiliary storage in corresponding display data.
Complete data render that application program is provided to behind auxiliary storage, according to display
Display deblocking in auxiliary storage is processed simultaneously by data with the corresponding relation of each target screen
Sending corresponding video flowing, so, the video flowing receiving is stored in this locality by each target device
Main storage area in, for the display of locally displayed screen.
Input mapping block 203, for exporting the display of each target screen and interactively entering mapping
To described auxiliary storage.
After completing split screen display available, the device of the embodiment of the present invention is by the input weight on arbitrary target screen
It is mapped to the auxiliary storage of main equipment, reads for application program, thus realizing application journey
Sort run in main equipment, be shown in multiple equipment while, moreover it is possible to realize on the master to appoint
The mutual process of user on meaning equipment.
To sum up, the device of the embodiment of the present invention instructs corresponding in auxiliary storage according to split screen
Display data are separately sent to corresponding target screen, and remap the input on each target screen
To auxiliary storage so that when using the device of the embodiment of the present invention to carry out multi-screen interactive, except master
Outside equipment, it is not required that the compatibility to application program for the miscellaneous equipment, it also avoid and run into multi-screen application
Exploitation between heterogeneous device Overpassing Platform by Using, customized development, application issue, safeguard and rise
Level, the difficulty of the aspects such as user authentication.
In the device of the embodiment of the present invention, split screen instruction can be user's input or previous from this locality
Setting in read, it is possible to for user's input and locally stored previously positioned combination.Auxiliary
Help memory block can be original frame buffer (for example: rearmounted caching) on main equipment, it is possible to for ringing
The storage region answered split screen to instruct and again choose.Now, the device of the embodiment of the present invention also wraps
Include:
Receiver module 204, is used for receiving split screen instruction；
Module 205 is set up in auxiliary storage, for setting up auxiliary according to the split screen instruction receiving
Memory block.
Additionally, in the device of the embodiment of the present invention, module 205 is set up in auxiliary storage can root
It is set adaptively the resolution of auxiliary storage according to the demand of the display quality etc. to target screen
Rate (include the adjustment to original frame buffer resolution ratio and again choose storage region big
Little setting).For example: set up auxiliary storage according to the resolution ratio of each target screen, to realize
The display of first water on target screen；Or build according to the corresponding relation of display data and each target screen
Vertical auxiliary storage；Certainly, it is possible to combine the resolution ratio of each target screen and display data with each
The corresponding relation of target screen sets up auxiliary storage.For failing rendering to auxiliary storage
When adjust to the situation of optimum resolution ratio, can send carry out to target screen
The adjustment of resolution ratio, it is possible to be not adjusted.
In order to perform exactly this split screen instruct and realize application program to user in each target
Mutual accurate response on screen, the device of the embodiment of the present invention needs to set up the master of each target screen
Mapping relations between memory block and the auxiliary storage of main equipment.Tool speech, real in the present invention
Executing in the device of example, rendering module 201 includes:
Rendering unit 2011, for the data render being provided the application program of local runtime
To auxiliary storage；
Output map unit 2012, for setting up the master of described auxiliary storage and each target screen
Mapping relations between memory block.
Additionally, in the device of the embodiment of the present invention, processing module 202 includes:
Data selecting unit 2021, for the corresponding relation according to display data and each target screen,
Sequentially or simultaneously choose each target screen corresponding display data.
Processing unit 2022, for being compressed coding etc. to described corresponding display data
Reason forms video flowing.
It should be noted that for the display realizing optimum quality on target screen, processing unit
2022 can process single according to the resolution ratio of the resolution adjustment of target screen video flowing to be sent
Unit 2022 also can not be adjusted to sent the resolution ratio of video flowing, but by target screen
Carry out the adjustment of resolution ratio in its this locality after video stream to target screen.
Transmitting element 2023, for the video flowing obtaining after corresponding target screen transmission process.
To sum up, the device of the embodiment of the present invention keeps applying any single screen by auxiliary storage
Compatibility to existing equipment；By auxiliary storage self adaptation, resolution ratio is set at multi-screen isomery screen
High-quality display is provided on curtain；Content by video flowing transmission multihead display is various different with compatibility
Structure equipment；Additionally, main equipment can be set by main by user's interactive controlling display content and ratio
Remap with mutual for carrying out display, and then determine actual mutual position to realize exactly
Multiple-screen integration is mutual.
Further illustrate the method and device of various embodiments of the present invention below by instantiation.
As it is shown on figure 3, there are three to show and processing equipment, TV A, mobile phone B and flat board
Computer C, three corresponding display width in units of pixel of equipment and high respectively WA、HA、
WB、HB、WCAnd HC, resolution ratio is respectively as follows: WA×HA、WB×HB、WC×HC。
Assume that user browses video website by panel computer C, such as youtube.com etc.,
Panel computer C is main equipment.Generally, the webpage zone line of this type of website will present video
Content, video lower zone has some review information, and right area can arrange some and recommend
Video.User can trigger split screen display available on panel computer C and enter the input of split screen instruction
Namely the parameter setting unit of multi-screen application: by touch screen delineation video content region 1, and
Optional equipment is chosen the intended recipient device as this region 1 for the TV A；Then draw a circle to approve again
Recommend video area 2 and choose mobile phone B as intended recipient device；Finally delineation comment region
3 using this panel computer C as intended recipient device.After completing the input of split screen instruction, system
Automatically it is sent to target device after each regional display content being adjusted resolution ratio.User can be in office
On meaning equipment alternately, in mobile phone B, such as click on another one and recommend video, this panel computer
After current browser on C receives this input being mapped back by system, the recommendation of click can be opened
Video is simultaneously sent automatically to the content of renewal on TV A and mobile phone B.User also can be
This panel computer C triggers new multi-screen application at any time, re-enters triggering command namely joins
The modification of number setting or other interactive operations such as startup, stopping.Work as if user selects to close
Front application, as exited current browser, then system can be automatically stopped multi-screen application.
Above flow process as shown in Figure 4, uses the present invention real on main equipment panel computer C
The process of the method enforcement multi-screen application executing example is as follows:
S401. on panel computer C, start browser and browse video website.
S402. split screen instruction is received on panel computer C.User inputs split screen by the following means
Instruction: draw a circle to approve video content region 1 by touch screen, and choose TV A work in optional equipment
Intended recipient device for this region 1；Delineation is recommended video area 2 and chooses mobile phone B conduct
Intended recipient device；Delineation comment region 3 is using this panel computer C as intended recipient device.
S403. according to display data pass corresponding with TV A, mobile phone B and panel computer C
System sets up auxiliary storage.
Assume region the 1st, 2 and 3 width in units of pixel and high be respectively W1、H1、W2、
H2、W3And H3, then the auxiliary storage set up and show number in rendering rear auxiliary storage
According to distribution as shown in Figure 5.According to simple geometric operation can obtain shown in Fig. 5 auxiliary
Help the display width in units of pixel of memory block and high respectively Wb=W1+W2,
Hb=H1+H3。
It is of course also possible to use other auxiliary storage Establishment strategies, for example directly use main setting
The resolution ratio of standby back buffer, adjusts the resolution ratio in each region to fit in step afterwards
Join target screen；Or the resolution ratio according to each target screen builds auxiliary storage, to ensure correspondence
Content all can clearly show on the display screen of each equipment.
S404. the browser program and the video reproduction program that run on panel computer C are carried
The data render of confession is to auxiliary storage.
S405. set up TV A, the main storage area of mobile phone B and the auxiliary of panel computer C to store
The mapping relations in district.
S406. according to split screen instruction, chosen area 1 corresponding display data, it is become
Shape, compression, coding and resolution adjustment etc. form video flowing after processing and are sent to TV A；
Chosen area 2 corresponding display data, carry out to it deforming, compress, encode and resolution ratio
Adjustment etc. form video flowing after processing and are sent to mobile phone B；Chosen area 3 corresponding display number
According to, carry out to it deforming, compress, encode and resolution adjustment etc. process after form video flowing
And be shown on panel computer C.
Owing in this example, auxiliary storage shows data and each target screen according to be sent
Corresponding relation is set up, and therefore includes the resolution according to corresponding target screen in step S406
The adjustment to data resolution to be sent for the rate.It should be noted that step S406 is to each region
Corresponding display data can also can be processed simultaneously successively.Additionally, can be in step S406
Complete the adjustment of the resolution ratio to sent video flowing, also can not be adjusted in this step,
Each carry out the adjustment of resolution ratio again after each target screen receives video flowing.
If S407. user again inputs the instruction of new split screen on panel computer C and i.e. have updated
Multi-screen parameter is arranged, then return step S402, otherwise, step S408.
S408. judge whether user finishes browser program, if terminating, then process ends,
Otherwise, step S409.
S409. judging whether to be inputted on each target screen, if there being input, then performing step
Rapid S410, otherwise, returns step S404.
The input carrying out on each target screen is for example: clicks on another one in mobile phone B and recommends to regard
Frequently；Beginning/the stopping etc. carrying out screen on panel computer C operates.
S410. the input of each target screen is mapped to described auxiliary storage.
S411. browser program or video reproduction program response is mapped to each of auxiliary storage
The input of target screen produces corresponding data, and returns step S404.
Clicking on, in response mobile phone B, the input that another one recommends video, it is right that browser program provides
Ying Yu " turns on corresponding recommendation video and the content of renewal is sent to TV A and mobile phone B "
Data；The operations such as the beginning/stopping of the screen on response panel computer C, video playback journey
Sequence provides corresponding to " starting/stopping currently playing video and the content of renewal is sent to electricity
Depending on A " data.
As shown in Figure 6, the another kind of image processing apparatus 600 for the present invention also embodiment, this
Implementing of image processing apparatus 600 is not limited by invention specific embodiment.Such as Fig. 6
Shown in, this device may include that
Processor (processor) the 610th, communication interface (Communications Interface) is the 620th,
Memory (memory) 630 and communication bus 640.Wherein:
Processor the 610th, communication interface 620 and memory 630 pass through communication bus 640
Complete mutual communication.
Communication interface 620, for the net element communication with such as client etc..
Processor 610, is used for performing program 632, specifically can perform shown in above-mentioned Fig. 1
Correlation step in embodiment of the method.
Specifically, program 632 can include program code, and described program code includes computer
Operational order.
Processor 610 is probably a central processor CPU, or specific integrated circuit
ASIC(Application Specific Integrated Circuit), or be configured to implement
One or more integrated circuits of the embodiment of the present invention.
Memory 630, is used for depositing program 632.Memory 630 may comprise high-speed RAM
Memory, it is also possible to also include nonvolatile memory (non-volatile memory), for example
At least one magnetic disc store.Program 632 specifically may include that
Rendering module, for being carried the application program of local runtime according to current split screen instruction
The data render of confession is to auxiliary storage；
Processing module, for sending described auxiliary according to current split screen instruction to corresponding target screen
Corresponding display data in helping memory block；And
Input mapping block, is mapped to institute for exporting and interactively entering the display of each target screen
State auxiliary storage.
In program 632, each unit implements may refer in embodiment illustrated in fig. 2 corresponding
Unit, is not repeated herein.Those skilled in the art is it can be understood that arrive, for describing
Convenience and succinct, the equipment of foregoing description and the specific works process of module, before being referred to
State the corresponding process in embodiment of the method to describe, do not repeat them here.
Those of ordinary skill in the art are it is to be appreciated that combine the embodiments described herein and retouch
The unit of each example stated and method step, can with electronic hardware or computer software and
Being implemented in combination in of electronic hardware.These functions perform with hardware or software mode actually,
Depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can be to often
Individual specifically should being used for uses different methods to realize described function, but this realizes not
It is considered as beyond the scope of this invention.
If described function realizes and as independent product pin using the form of SFU software functional unit
When selling or use, can be stored in a computer read/write memory medium.Based on such
Understand, the part that prior art is contributed by technical scheme substantially in other words or
The part of this technical scheme of person can embody with the form of software product, this computer software
Product is stored in a storage medium, including some instructions are with so that a computer equipment
(can be personal computer, server, or the network equipment etc.) performs the present invention, and each is real
Execute all or part of step of method described in example.And aforesaid storage medium includes: USB flash disk, shifting
Dynamic hard disk, read-only storage (ROM, Read-Only Memory), random access memory
(RAM, Random Access Memory), magnetic disc or CD etc. are various can store journey
The medium of sequence code.
Embodiment of above is merely to illustrate the present invention, and not limitation of the present invention, relevant
The those of ordinary skill of technical field, without departing from the spirit and scope of the present invention,
Can also make a variety of changes and modification, therefore all equivalent technical schemes fall within the present invention
Category, the scope of patent protection of the present invention should be defined by the claims.
Claims (22)
1. an image processing method, it is characterised in that described method includes step:
The data application program that local device runs being provided according to current split screen instruction
It is rendered into auxiliary storage；
It is right to send in described auxiliary storage to corresponding target screen according to current split screen instruction
The display data answered；And
The display of each target screen is exported and interactively enters and is mapped to described auxiliary storage；
Wherein, described auxiliary storage is for the object of the read-write operation as described application program,
Main storage area storage the showing corresponding to the display of the display screen of described local device of local device
Registration evidence, the corresponding main storage area of each target screen stores the display corresponding to described target screen respectively
Display data.
2. method according to claim 1, it is characterised in that described method also includes
Step:
Receive split screen instruction；
Auxiliary storage is set up in split screen instruction according to receiving.
3. method according to claim 2, it is characterised in that described split screen instruction bag
Include the resolution ratio of each target screen；
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Set up auxiliary storage according to the resolution ratio of described each target screen.
4. method according to claim 2, it is characterised in that described split screen instruction bag
Include the corresponding relation of display data and each target screen；
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Set up auxiliary storage according to the corresponding relation of described display data and each target screen.
5. method according to claim 2, it is characterised in that described split screen instruction bag
Include the resolution ratio of each target screen and the corresponding relation of display data and each target screen；
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Resolution ratio according to described each target screen and display data pass corresponding with each target screen
System sets up auxiliary storage.
6. the method according to according to any one of claim 1-5, it is characterised in that described
Split screen instruction includes that the resolution ratio of each target screen and display data are corresponding with each target screen
Relation, and the corresponding relation of the resolution ratio of described each target screen and display data and each target screen
Inputted and/or obtained from this locality by user.
7. method according to claim 1, it is characterised in that described basis is current
The data render that the application program that local device runs is provided by split screen instruction is to auxiliary storage
The step in district includes:
The data render being provided the application program that local device runs is to auxiliary storage；And
Set up the mapping between described auxiliary storage and the corresponding main storage area of each target screen to close
System.
8. method according to claim 1, it is characterised in that in the instruction of described split screen
Including the corresponding relation of display data and each target screen；
The current split screen instruction of described basis sends described auxiliary storage to corresponding target screen
The step of interior corresponding display data includes:
According to the corresponding relation of display data and each target screen, choose corresponding display data；
Described corresponding display data are processed；
Display data after corresponding target screen transmission is processed.
9. method according to claim 8, it is characterised in that in the instruction of described split screen
Including the resolution ratio of each target screen；
The described step processing described corresponding display data includes:
The resolution ratio of the resolution adjustment corresponding display data according to target screen.
10. method according to claim 7, it is characterised in that described main storage area is used
In the display data storing the display corresponding to target screen.
11. methods according to claim 1, it is characterised in that described target screen includes
Local device display screen.
12. 1 kinds of image processing apparatus, it is characterised in that described device includes:
Rendering module, for the application program run local device according to current split screen instruction
The data render being provided is to auxiliary storage；
Processing module, for sending described auxiliary according to current split screen instruction to corresponding target screen
Corresponding display data in helping memory block；And
Input mapping block, is mapped to institute for exporting and interactively entering the display of each target screen
State auxiliary storage；
Wherein, described auxiliary storage is for the object of the read-write operation as described application program,
Main storage area storage the showing corresponding to the display of the display screen of described local device of local device
Registration evidence, the corresponding main storage area of each target screen stores the display corresponding to described target respectively
Display data.
13. devices according to claim 12, it is characterised in that described device also wraps
Include:
Receiver module, is used for receiving split screen instruction；
Module is set up in auxiliary storage, for the split screen instruction receiving according to described receiver module
Set up auxiliary storage.
14. devices according to claim 13, it is characterised in that described split screen instructs
Including the resolution ratio of each target screen；
Described auxiliary storage is set up module and is set up auxiliary according to the resolution ratio of described each target screen
Memory block.
15. devices according to claim 13, it is characterised in that described split screen instructs
Including the corresponding relation of display data and each target screen；
It is corresponding with each target screen according to described display data that module is set up in described auxiliary storage
Relation sets up auxiliary storage.
16. devices according to claim 13, it is characterised in that described split screen instructs
Including the corresponding relation of the resolution ratio of each target screen and display data and each target screen；
Module is set up according to the resolution ratio of described each target screen and display in described auxiliary storage
The corresponding relation of data and each target screen sets up auxiliary storage.
17. devices according to according to any one of claim 12-16, it is characterised in that institute
State split screen instruction and include the resolution ratio of each target screen and the right of display data and each target screen
Should be related to, and described each target screen resolution ratio and display data corresponding with each target screen pass
System is inputted and/or obtained from this locality by user.
18. devices according to claim 12, it is characterised in that described rendering module
Including:
Rendering unit, for arriving the data render that the application program that local device runs is provided
Auxiliary storage；And
Output map unit, is used for setting up described auxiliary storage and the corresponding main memory of each target screen
Mapping relations between storage area.
19. devices according to claim 12, it is characterised in that described split screen instructs
Include the corresponding relation showing data and each target screen；
Described processing module includes:
Data selecting unit, for according to display data and the corresponding relation of each target screen, choosing
Corresponding display data；
Processing unit, for processing to described corresponding display data；
Transmitting element, for the display data after corresponding target screen transmission process.
20. devices according to claim 19, it is characterised in that described split screen instructs
Include the resolution ratio of each target screen；
Described processing unit is according to the resolution of the resolution adjustment corresponding display data of target screen
Rate.
21. devices according to claim 18, it is characterised in that described main storage area
For storing the display data of the display corresponding to target screen.
22. devices according to claim 12, it is characterised in that described target screen bag
Include local device display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310268258.5A CN103365621B (en) | 2013-06-28 | 2013-06-28 | Image processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310268258.5A CN103365621B (en) | 2013-06-28 | 2013-06-28 | Image processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103365621A CN103365621A (en) | 2013-10-23 |
| CN103365621B true CN103365621B (en) | 2016-10-05 |
Family
ID=49367073
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310268258.5A Active CN103365621B (en) | 2013-06-28 | 2013-06-28 | Image processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103365621B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104656873B (en) * | 2013-11-25 | 2018-02-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| US9832342B2 (en) | 2014-08-22 | 2017-11-28 | Xiaomi Inc. | Method and device for transmitting image |
| CN104717543B (en) * | 2015-02-28 | 2017-02-01 | 努比亚技术有限公司 | Method and device for achieving interactive operation between different split screens |
| CN106527885A (en) * | 2016-09-29 | 2017-03-22 | 京能世纪物联网技术（北京）有限公司 | Screen display method and device for monitoring equipment |
| CN107483854B (en) * | 2017-08-30 | 2020-09-08 | 深圳创维－Rgb电子有限公司 | Multi-screen display method and multi-screen television |
| CN107908380B (en) * | 2017-10-31 | 2021-04-16 | 厦门海为科技有限公司 | Configuration-based multi-screen display method and device, terminal equipment and storage medium |
| CN108399039A (en) * | 2018-02-09 | 2018-08-14 | 北京硬壳科技有限公司 | A kind of large-size screen monitors control method and device |
| CN110018804B (en) * | 2019-04-12 | 2021-02-02 | 京东方科技集团股份有限公司 | Display device, image display method and electronic equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101404151A (en) * | 2008-08-04 | 2009-04-08 | 广东威创视讯科技股份有限公司 | Multi-screen splicing apparatus and method |
| CN102185884A (en) * | 2011-03-18 | 2011-09-14 | 北京易视腾科技有限公司 | Multi-screen interaction method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9310994B2 (en) * | 2010-02-19 | 2016-04-12 | Microsoft Technology Licensing, Llc | Use of bezel as an input mechanism |
-
2013
- 2013-06-28 CN CN201310268258.5A patent/CN103365621B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101404151A (en) * | 2008-08-04 | 2009-04-08 | 广东威创视讯科技股份有限公司 | Multi-screen splicing apparatus and method |
| CN102185884A (en) * | 2011-03-18 | 2011-09-14 | 北京易视腾科技有限公司 | Multi-screen interaction method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103365621A (en) | 2013-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103365621B (en) | Image processing method and device | |
| CN102591650B (en) | Companion window is experienced | |
| CN109933760A (en) | List generation method, device, computer equipment and computer readable storage medium | |
| CN102981814B (en) | For the method and apparatus for the application for developing imaging device | |
| CN103338235B (en) | On mobile phone, realize the method for dynamic wallpaper interactive mode, personalized creation | |
| CN106164904A (en) | Client-side individual voice WEB navigates | |
| CN107480893A (en) | A kind of flow method of combination and device | |
| CN110300328A (en) | A kind of video playing control method, device and readable storage medium storing program for executing | |
| CN104598107A (en) | Generating method and system of interface control | |
| US20190354261A1 (en) | System and method for creating visual representation of data based on generated glyphs | |
| CN109725948A (en) | A kind of configuration method and device of animation resource | |
| CN110378410A (en) | Multi-tag scene classification method, device and electronic equipment | |
| CN108737739A (en) | A kind of preview screen acquisition method, preview screen harvester and electronic equipment | |
| CN110070496A (en) | Generation method, device and the hardware device of image special effect | |
| CN108733296A (en) | Method for deleting, device and the equipment of written handwriting | |
| CN109582882A (en) | Search result shows method, apparatus and electronic equipment | |
| CN110532159A (en) | Data decryptor method, apparatus, equipment and computer readable storage medium | |
| CN101742143A (en) | Television with multi-user customization function and implementing method thereof | |
| CN106445344A (en) | Screenshot processing method and device | |
| CN103218112A (en) | Information processing method and information processing system | |
| CN110309444A (en) | A kind of page display method, device, medium and server | |
| CN106598530A (en) | Display panel configuration method and device | |
| CN103999044A (en) | Techniques for multiple pass rendering | |
| CN105630893B (en) | A kind of display methods and device of group picture title | |
| CN105051788A (en) | Graphics processing using multiple primitives |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |