CN103365621A - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
CN103365621A
CN103365621A CN2013102682585A CN201310268258A CN103365621A CN 103365621 A CN103365621 A CN 103365621A CN 2013102682585 A CN2013102682585 A CN 2013102682585A CN 201310268258 A CN201310268258 A CN 201310268258A CN 103365621 A CN103365621 A CN 103365621A
Authority
CN
China
Prior art keywords
auxiliary storage
target screen
screen
data
resolution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013102682585A
Other languages
Chinese (zh)
Other versions
CN103365621B (en
Inventor
杜琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhigu Ruituo Technology Services Co Ltd
Original Assignee
Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhigu Ruituo Technology Services Co Ltd filed Critical Beijing Zhigu Ruituo Technology Services Co Ltd
Priority to CN201310268258.5A priority Critical patent/CN103365621B/en
Publication of CN103365621A publication Critical patent/CN103365621A/en
Application granted granted Critical
Publication of CN103365621B publication Critical patent/CN103365621B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides an image processing method and an image processing device. The image processing method comprises the steps as follows: data provided by a locally run application program are rendered to an auxiliary storage area via a current screen splitting instruction; corresponding display data in the auxiliary storage area are sent to corresponding target screens via the current screen splitting instruction; input of each target screen is mapped to the auxiliary storage area. According to the method and the device, the corresponding display data in the auxiliary storage area are respectively sent to corresponding target screens via the screen splitting instruction, and the input of each target screen is mapped to the auxiliary storage area again, so that when the method and the device provided by the embodiment of the invention perform multi-screen interaction, other equipment, except the main equipment, is not required to be compatible with the application program, as a result, difficulties in development of multi-screen application in cross-platform communication, customized development, application release, maintenance and upgrade, user authentication and the like on heterogeneous devices are avoided.

Description

Image processing method and device
Technical field
The present invention relates to technical field of image processing, relate in particular to a kind of multiple images processing method and device.
Background technology
The concept of multi-screen fusing interdynamic is progressively popularized in recent years, and the development of multi-screen fusing interdynamic technology has expedited the emergence of a lot of new application scenarioss, such as: play the displaying contents of panel computer etc. with the mobile phone remote intelligent television, by TV.Same aobvious, collaborative, alternately and virtually can satisfy multiple daily Digital Life demand between the multi-screen, day by day be subject to user's welcome, in order to realize the multi-screen fusing interdynamic, usually require to move on the isomery equipment application program that can realize at multi-screen mutual same application program and same version, but there are many difficulties in the exploitation that multi-screen is used at the aspects such as demonstration, communication, operating system and development platform of isomery equipment, and the speed of development that multi-screen is used also so slower.
Summary of the invention
The technical problem to be solved in the present invention is: a kind of image processing method and device are provided, can realize the multi-screen fusing interdynamic under the prerequisite of the difficulty of the aspects such as demonstration, communication, operating system and development platform of isomery equipment avoiding meeting with the multi-screen application and development.
For solving the problems of the technologies described above, first aspect, the embodiment of the invention provide a kind of image processing method, and described method comprises step:
According to current split screen instruction the data that the application program of local runtime provides are rendered into auxiliary storage;
Send demonstration data corresponding in the described auxiliary storage according to current split screen instruction to corresponding target screen; And
Demonstration output and the mutual input of each target screen are mapped to described auxiliary storage.
In conjunction with first aspect, in the possible embodiment of the first, described method also comprises step:
Receive the split screen instruction;
Set up auxiliary storage according to the split screen instruction that receives.
In conjunction with the possible embodiment of the first of first aspect, in the possible embodiment of the second, described split screen instruction comprises the resolution of each target screen;
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Resolution according to described each target screen is set up auxiliary storage.
In conjunction with the possible embodiment of the first of first aspect, in the third possible embodiment, described split screen instruction comprises the corresponding relation that shows data and each target screen;
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Corresponding relation according to described demonstration data and each target screen is set up auxiliary storage.
In conjunction with the possible embodiment of the first of first aspect, in the 4th kind of possible embodiment, described split screen instruction comprises the resolution of each target screen and the corresponding relation that shows data and each target screen;
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Set up auxiliary storage according to the resolution of described each target screen and the corresponding relation of demonstration data and each target screen.
Above-mentioned any possible embodiment in conjunction with first aspect or first aspect, in the 5th kind of possible embodiment, comprise the resolution of each target screen and the corresponding relation that shows data and each target screen in the described split screen instruction, and the corresponding relation of the resolution of described each target screen and demonstration data and each target screen obtains by user's input and/or from this locality.
In conjunction with first aspect, in the 6th kind of possible embodiment, the step that the described data that the application program of local runtime provided according to current split screen instruction are rendered into auxiliary storage comprises:
The data that the application program of local runtime is provided are rendered into auxiliary storage; And
Set up the mapping relations between the main storage area of described auxiliary storage and each target screen.
In conjunction with first aspect, in the 7th kind of possible embodiment, comprise the corresponding relation that shows data and each target screen in the described split screen instruction;
Describedly comprise to the step that corresponding target screen sends in the described auxiliary storage corresponding demonstration data screen according to current split screen instruction:
According to the corresponding relation that shows data and each target screen, choose corresponding demonstration data;
Demonstration data to described correspondence are processed;
Demonstration data after the target screen transmission processing of correspondence.
In conjunction with the 7th kind of possible embodiment of first aspect, in the 8th kind of possible embodiment, comprise the resolution of each target screen in the described split screen instruction;
The described step that the demonstration data of described correspondence are processed comprises:
Resolution according to demonstration data corresponding to the resolution adjustment of target screen.
In conjunction with the 6th kind of possible embodiment of first aspect, in the 19 possible embodiment, described main storage area is used for storage corresponding to the demonstration data of the demonstration of target screen.
In conjunction with first aspect, in the tenth kind of possible embodiment, described auxiliary storage is used for the read-write operation object as local application.
In conjunction with above-mentioned any possible embodiment of first aspect, in the 11 kind of possible embodiment, described target screen comprises local display screen.
Second aspect, the embodiment of the invention provide a kind of image processing apparatus, and described device comprises:
Rendering module is used for according to current split screen instruction the data that the application program of local runtime provides being rendered into auxiliary storage;
Processing module is used for sending demonstration data corresponding in the described auxiliary storage according to current split screen instruction to corresponding target screen; And
Input remaps module, is used for demonstration output and the mutual input of each target screen are mapped to described auxiliary storage.
In conjunction with second aspect, in the possible embodiment of the first, described device also comprises:
Receiver module is used for receiving the split screen instruction;
Auxiliary storage is set up module, is used for setting up auxiliary storage according to the split screen instruction that described receiver module receives.
In conjunction with the possible embodiment of the first of second aspect, in the possible embodiment of the second, described split screen instruction comprises the resolution of each target screen;
Described auxiliary storage is set up module and is set up auxiliary storage according to the resolution of described each target screen.
In conjunction with the possible embodiment of the first of second aspect, in the third possible embodiment, described split screen instruction comprises the corresponding relation that shows data and each target screen;
Described auxiliary storage is set up module and is set up auxiliary storage according to the corresponding relation of described demonstration data and each target screen.
In conjunction with the possible embodiment of the first of second aspect, in the 4th kind of possible embodiment, described split screen instruction comprises the resolution of each target screen and the corresponding relation that shows data and each target screen;
Described auxiliary storage is set up module and is set up auxiliary storage according to the corresponding relation of the resolution of described each target screen and demonstration data and each target screen.
Above-mentioned any possible embodiment in conjunction with second aspect or second aspect, in the 5th kind of possible embodiment, comprise the resolution of each target screen and the corresponding relation that shows data and each target screen in the described split screen instruction, and the corresponding relation of the resolution of described each target screen and demonstration data and each target screen obtains by user's input and/or from this locality.
In conjunction with second aspect, in the 6th kind of possible embodiment, described rendering module comprises:
Rendering unit, the data that provide for the application program with local runtime are rendered into auxiliary storage; And
The output map unit is for the mapping relations between the main storage area of setting up described auxiliary storage and each target screen.
In conjunction with second aspect, in the 7th kind of possible embodiment, comprise the corresponding relation that shows data and each target screen in the described split screen instruction;
Described processing module comprises:
Data selecting unit is used for choosing corresponding demonstration data according to the corresponding relation that shows data and each target screen;
Processing unit is used for the demonstration data of described correspondence are processed;
Transmitting element is for the demonstration data after the target screen transmission processing of correspondence.
In conjunction with the 7th kind of possible embodiment of second aspect, in the 8th kind of possible embodiment, comprise the resolution of each target screen in the described split screen instruction;
Described processing unit is according to the resolution of demonstration data corresponding to the resolution adjustment of target screen.
In conjunction with the 6th kind of possible embodiment of second aspect, in the 9th kind of possible embodiment, described main storage area is used for storage corresponding to the demonstration data of the demonstration of target screen.
In conjunction with second aspect, in the tenth kind of possible embodiment, described auxiliary storage is used for the read-write operation object as local application.
In conjunction with above-mentioned any possible embodiment of second aspect, in the 11 kind of possible embodiment, described target screen comprises local display screen.
Method and apparatus of the present invention sends to respectively corresponding target screen according to the split screen instruction with the corresponding data that show in the auxiliary storage, and the input on each target screen is remapped to auxiliary storage, so that when using the method for the embodiment of the invention to carry out multi-screen interactive, except main equipment, do not require the compatibility of miscellaneous equipment application programs, also avoided running into the exploitation of multi-screen application at isomery equipment room Overpassing Platform by Using, customized development, use issue, safeguard and upgrading, the user such as authenticates at the difficulty of aspect.
Description of drawings
Fig. 1 is the process flow diagram of the image processing method of the embodiment of the invention;
Fig. 2 is a kind of structural representation of the image processing apparatus of the embodiment of the invention;
Fig. 3 is the application scenarios synoptic diagram of an example of the image processing method of the embodiment of the invention;
Fig. 4 is the process flow diagram of an example of the image processing method of the embodiment of the invention;
Fig. 5 is the distribution synoptic diagram of auxiliary storage in the example of image processing method of the embodiment of the invention;
Fig. 6 is the another kind of structural representation of the image processing apparatus of the embodiment of the invention.
Embodiment
Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples are used for explanation the present invention, but are not used for limiting the scope of the invention.
Each embodiment for a better understanding of the present invention, now do following explanation to employed term in the various embodiments of the present invention:
Main equipment also claims local device, the equipment for running application in various embodiments of the present invention.
Target device is used for the equipment according to user's needs display part main equipment displaying contents.
Main equipment and target device can be any fixed or movable equipment with demonstration and processing power, for example: computing machine, portable notebook computer, mobile phone, panel computer, TV, mobile unit and wearable equipment.As target device the time, this equipment can not have any processing power.
The main storage area, each equipment has the main storage area in (comprising main equipment and each target device), and storage is corresponding to the demonstration data of the demonstration of the display screen of each equipment.
Auxiliary storage, be used for the object as the read-write operation of local (main equipment) application program, it can be arranged in the optional position of master system storer (internal memory), also can be arranged in the optional position in main equipment extended memory (for example hard disk, mobile storage space of connecting by USB interface etc.), the application program of moving on the main equipment is directly carried out read-write operation to this auxiliary storage under graphic model.
In various embodiments of the present invention, the data that running application on the main equipment provides will be rendered into auxiliary storage, the read-write object of application program is this auxiliary storage, be rendered into auxiliary storage demonstration data afterwards as the memory contents in the main storage area of main equipment, the demonstration of the display screen of main equipment is corresponding to the demonstration data of storing in the main storage area, the demonstration data of storing in the primary storage of the demonstration of the display screen on each target screen corresponding to each target screen.In other words, the demonstration data of storing in the main storage area of the content that the user sees on the display screen of each equipment corresponding to each equipment, and the content that application program is read and write is the content of the auxiliary storage of main equipment.
As shown in Figure 1, the image processing method of the embodiment of the invention comprises step:
S101. according to current split screen instruction the data that the application program of local runtime provides are rendered into auxiliary storage.
In the method for the embodiment of the invention, the split screen instruction also can be described as the setting of multi-screen parameter, preferably include: the resolution of split screen trigger command, each target screen and the corresponding relation that shows data and each target screen, the split screen instruction can be inputted simultaneously also and can input successively as required.The split screen trigger command refers to come into effect the order of split screen, and this order can be touch-control order, voice command etc.Corresponding to the demonstration data of different target screen are can be all identical, part is identical, can be entirely not identical yet.Need to prove that in the method for the embodiment of the invention, target screen also comprises the display screen of main equipment.
S102. send the demonstration data of correspondence in the described auxiliary storage to corresponding target screen with the form of video flowing according to current split screen instruction.
Finish the data that application program is provided be rendered into auxiliary storage after, according to the corresponding relation that shows data and each target screen corresponding video flowing is processed and sent to the demonstration deblocking in the auxiliary storage, like this, each target device is stored in the video flowing that receives in the local main storage area, for the demonstration of local display screen.
S103. demonstration output and the mutual input with each target screen is mapped to described auxiliary storage.
After finishing the split screen demonstration, the method of the embodiment of the invention is remapped to the demonstration output on the arbitrary target screen and mutual input the auxiliary storage of main equipment, read for application program, thereby when realizing that application program runs on main equipment, is shown in a plurality of equipment, can also realize processing to the user interactions on any apparatus at main equipment.
To sum up, the method of the embodiment of the invention sends to respectively corresponding target screen according to the split screen instruction with the corresponding data that show in the auxiliary storage, and the input on each target screen is remapped to auxiliary storage, so that when using the method for the embodiment of the invention to carry out multi-screen interactive, except main equipment, do not require the compatibility of miscellaneous equipment application programs, also avoided running into the exploitation of multi-screen application at isomery equipment room Overpassing Platform by Using, customized development, use issue, safeguard and upgrading, the user such as authenticates at the difficulty of aspect.
In the method for the embodiment of the invention, the split screen instruction can be user input or from this locality previous arrange read, also can be the combination of user input and the previous setting of local storage.Auxiliary storage (for example: rearmounted buffer memory (back buffer)), also can be the storage area that responds the split screen instruction and again choose can be original frame buffer on the main equipment.At this moment, the method for the embodiment of the invention also comprises:
S001. receive the split screen instruction;
S002. set up auxiliary storage according to the split screen instruction that receives.
In addition, in the method for the embodiment of the invention, the resolution (comprising the setting to the size of the adjustment of original frame buffer resolution and the storage area again chosen) of auxiliary storage can be set adaptively according to the demand to display quality of target screen etc.For example: the resolution according to each target screen is set up auxiliary storage, with the demonstration of the upper E.B.B. of realize target screen; Or set up auxiliary storage according to the corresponding relation that shows data and each target screen; Certainly, also can set up auxiliary storage in conjunction with the resolution of each target screen and the corresponding relation of demonstration data and each target screen.For the situation of failing when playing up to auxiliary storage, to be adjusted to optimum resolution, can before or after being sent to target screen, carry out the adjustment of resolution, can not adjust yet.
In order to carry out exactly this split screen instruction and to realize application program to the mutual accurate response of user on each target screen, the method for the embodiment of the invention need to be set up the mapping relations between the auxiliary storage of the main storage area of each target screen and main equipment.Tool is sayed it, and in the method for the embodiment of the invention, step S101 comprises:
S1011. the data that the application program of local runtime provided are rendered into auxiliary storage;
S1012. set up the mapping relations between the main storage area of described auxiliary storage and each target screen.
In the method for the embodiment of the invention, step S102 comprises:
S1021. according to the corresponding relation that shows data and each target screen, choose successively or simultaneously demonstration data corresponding to each target screen.
S1022. the demonstration data of described correspondence are carried out the processing formation video flowings such as compressed encoding.
Need to prove, in order to be implemented in the demonstration of optimum quality on the target screen, in this step, can according to the resolution of the resolution adjustment of target screen video flowing to be sent, also can after sending to target screen, video flowing be carried out the adjustment of resolution in its this locality by target screen.
S1023. the video flowing that obtains after the target screen transmission processing of correspondence.
To sum up, the method for the embodiment of the invention keeps the compatibility of any single screen application to existing equipment by auxiliary storage; By the auxiliary storage self-adaptation resolution is set and provides high-quality display at multi-screen isomery screen; Content by the video streaming multihead display is with the various isomery equipment of compatibility; In addition, main equipment can be shown and mutual remapping by main equipment by user interactions control display content and ratio, and then determine that actual mutual position is mutual to realize that exactly multi-screen merges.
As shown in Figure 2, the image processing apparatus 200 of the embodiment of the invention comprises:
Rendering module 201 is used for according to current split screen instruction the data that the application program of local runtime provides being rendered into auxiliary storage.
In the device of the embodiment of the invention, the split screen instruction also can be described as the setting of multi-screen parameter, preferably include: the resolution of split screen trigger command, each target screen and the corresponding relation that shows data and each target screen, the split screen instruction can be inputted simultaneously also and can input successively as required.The split screen trigger command refers to come into effect the order of split screen, and this order can be touch-control order, voice command etc.Corresponding to the demonstration data of different target screen are can be all identical, part is identical, can be entirely not identical yet.Need to prove that in the device of the embodiment of the invention, target screen also comprises the display screen of main equipment.
Processing module 202 is for the demonstration data that send correspondence in the described auxiliary storage according to current split screen instruction with the form of video flowing to corresponding target screen.
Finish the data that application program is provided be rendered into auxiliary storage after, according to the corresponding relation that shows data and each target screen corresponding video flowing is processed and sent to the demonstration deblocking in the auxiliary storage, like this, each target device is stored in the video flowing that receives in the local main storage area, for the demonstration of local display screen.
Input mapping block 203 is used for demonstration output and the mutual input of each target screen are mapped to described auxiliary storage.
After finishing the split screen demonstration, the device of the embodiment of the invention is remapped to the input on the arbitrary target screen auxiliary storage of main equipment, read for application program, thereby when realizing that application program runs on main equipment, is shown in a plurality of equipment, can also realize processing to the user interactions on any apparatus at main equipment.
To sum up, the device of the embodiment of the invention sends to respectively corresponding target screen according to the split screen instruction with the corresponding data that show in the auxiliary storage, and the input on each target screen is remapped to auxiliary storage, so that when using the device of the embodiment of the invention to carry out multi-screen interactive, except main equipment, do not require the compatibility of miscellaneous equipment application programs, also avoided running into the exploitation of multi-screen application at isomery equipment room Overpassing Platform by Using, customized development, use issue, safeguard and upgrading, the user such as authenticates at the difficulty of aspect.
In the device of the embodiment of the invention, the split screen instruction can be user input or from this locality previous arrange read, also can be the combination of user input and the previous setting of local storage.Auxiliary storage (for example: rearmounted buffer memory), also can be the storage area that responds the split screen instruction and again choose can be original frame buffer on the main equipment.At this moment, the device of the embodiment of the invention also comprises:
Receiver module 204 is used for receiving the split screen instruction;
Auxiliary storage is set up module 205, is used for setting up auxiliary storage according to the split screen instruction that receives.
In addition, in the device of the embodiment of the invention, auxiliary storage is set up the resolution that module 205 can arrange adaptively according to the demand to display quality of target screen etc. auxiliary storage (comprising the setting to the size of the adjustment of original frame buffer resolution and the storage area again chosen).For example: the resolution according to each target screen is set up auxiliary storage, with the demonstration of the upper E.B.B. of realize target screen; Or set up auxiliary storage according to the corresponding relation that shows data and each target screen; Certainly, also can set up auxiliary storage in conjunction with the resolution of each target screen and the corresponding relation of demonstration data and each target screen.For the situation of failing when playing up to auxiliary storage, to be adjusted to optimum resolution, can before or after being sent to target screen, carry out the adjustment of resolution, can not adjust yet.
In order to carry out exactly this split screen instruction and to realize application program to the mutual accurate response of user on each target screen, the device of the embodiment of the invention need to be set up the mapping relations between the auxiliary storage of the main storage area of each target screen and main equipment.Tool is sayed it, and in the device of the embodiment of the invention, rendering module 201 comprises:
Rendering unit 2011, the data that provide for the application program with local runtime are rendered into auxiliary storage;
Output map unit 2012 is for the mapping relations between the main storage area of setting up described auxiliary storage and each target screen.
In addition, in the device of the embodiment of the invention, processing module 202 comprises:
Data selecting unit 2021 is used for choosing successively or simultaneously demonstration data corresponding to each target screen according to the corresponding relation that shows data and each target screen.
Processing unit 2022 forms video flowing for processing such as the demonstration data of described correspondence being carried out compressed encoding.
Need to prove, in order to be implemented in the demonstration of optimum quality on the target screen, processing unit 2022 can be according to the resolution of the resolution adjustment of target screen video flowing to be sent, processing unit 2022 can not adjusted to sent the resolution of video flowing yet, but carries out the adjustment of resolution by target screen its this locality after sending to target screen at video flowing.
Transmitting element 2023 is used for the video flowing that obtains after the target screen transmission processing of correspondence.
To sum up, the device of the embodiment of the invention keeps the compatibility of any single screen application to existing equipment by auxiliary storage; By the auxiliary storage self-adaptation resolution is set and provides high-quality display at multi-screen isomery screen; Content by the video streaming multihead display is with the various isomery equipment of compatibility; In addition, main equipment can be shown and mutual remapping by main equipment by user interactions control display content and ratio, and then determine that actual mutual position is mutual to realize that exactly multi-screen merges.
Further specify method and the device of various embodiments of the present invention below by instantiation.
As shown in Figure 3, there are three to show and treatment facility, TV A, mobile phone B and panel computer C, the wide and height of the demonstration take pixel as unit that three equipment is corresponding is respectively W A, H A, W B, H B, W CAnd H C, resolution is respectively: W A* H A, W B* H B, W C* H CSuppose the user by panel computer C browsing video website, such as youtube.com etc., panel computer C is main equipment.Usually, the webpage zone line of this type of website will present video content, and the video lower zone has some review information, and zone, the right can arrange some recommendation videos.The user can trigger at panel computer C that split screen shows and the input that enters the split screen instruction also is that the parameter that multi-screen is used arranges part: by touch screen delineation video content zone 1, and choose TV A as the target receiving equipment in this zone 1 in optional equipment; And then delineation is recommended video area 2 and is chosen mobile phone B as the target receiving equipment; At last delineation comment zone 3 with this panel computer C as the target receiving equipment.After finishing the input of split screen instruction, system sends to target device after automatically each regional displaying contents being adjusted resolution.The user can be mutual on any apparatus, for example click another one in mobile phone B and recommend video, after current browser on this panel computer C is received this input of being returned by system map, can turn on the recommendation video of click and the content of upgrading is sent on TV A and the mobile phone B automatically.The user also can trigger at any time new multi-screen at this panel computer C and use, and re-enters triggering command and also namely carries out modification or the startup of parameter setting, other interactive operations such as stops.If user selection is closed current application, as withdraw from current browser, then system can stop the multi-screen application automatically.
Above flow process as shown in Figure 4, at main equipment---it is as follows that panel computer C uses the method for the embodiment of the invention to implement the process that multi-screen uses:
S401. start browser and browsing video website at panel computer C.
S402. the upper reception of panel computer C split screen instruction.The user inputs the split screen instruction by following means: by touch screen delineation video content zone 1, and choose TV A as the target receiving equipment in this zone 1 in optional equipment; Delineation is recommended video area 2 and is chosen mobile phone B as the target receiving equipment; Delineation comment zone 3 with this panel computer C as the target receiving equipment.
S403. set up auxiliary storage according to the corresponding relation that shows data and TV A, mobile phone B and panel computer C.
Suppose zone 1,2 and 3 wide and high W of being respectively take pixel as unit 1, H 1, W 2, H 2, W 3And H 3, the auxiliary storage of then setting up and play up show data in the rear auxiliary storage distribution as shown in Figure 5.Can obtain the wide and height of the demonstration take pixel as unit of the auxiliary storage shown in Fig. 5 according to simple geometric operation and be respectively W b=W 1+ W 2, H b=H 1+ H 3
Certainly, also can adopt other auxiliary storage Establishment strategy, for example directly use the resolution of the back buffer of main equipment, after step in adjust each regional resolution with adaptive target screen; Perhaps the resolution according to each target screen makes up auxiliary storage, all can clear demonstration on the display screen of each equipment to guarantee corresponding content.
S404. the data that the browser program that panel computer C is upward moved and video reproduction program provide are rendered into auxiliary storage.
S405. set up the mapping relations of the auxiliary storage of the main storage area of TV A, mobile phone B and panel computer C.
S406. according to the split screen instruction, the demonstration data of chosen area 1 correspondence are out of shape, are formed video flowing and send to TV A after the processing such as compression, coding and resolution adjustment it; The demonstration data of chosen area 2 correspondences are out of shape, are formed video flowing and send to mobile phone B after the processing such as compression, coding and resolution adjustment it; The demonstration data of chosen area 3 correspondences are out of shape, are formed video flowing after the processing such as compression, coding and resolution adjustment and be shown on the panel computer C it.
Because auxiliary storage is to set up according to the corresponding relation of demonstration data to be sent and each target screen in this example, so in step S406, comprise according to the adjustment to data resolution to be sent of the resolution of the target screen of correspondence.Need to prove that step S406 can also can process demonstration data corresponding to each zone simultaneously successively.In addition, can in step S406, finish to sent the adjustment of the resolution of video flowing, in this step, also can not adjust, after each target screen receives video flowing, carry out separately again the adjustment of resolution.
If S407. the user has namely upgraded the setting of multi-screen parameter in the new split screen instruction of panel computer C input again, then return step S402, otherwise, execution in step S408.
S408. judge user's browser program that whether is through with, if finish, process ends then, otherwise, execution in step S409.
S409. judge whether to input at each target screen, if input is arranged, execution in step S410 then, otherwise, return step S404.
The input of carrying out at each target screen is for example: click another one in mobile phone B and recommend video; Carry out operation such as the beginning of screen/stop to wait at panel computer C.
S410. the input with each target screen is mapped to described auxiliary storage.
S411. browser program or the video reproduction program response input of each target screen that is mapped to auxiliary storage produces corresponding data, and returns step S404.
Click the input that another one is recommended video on the response mobile phone B, browser program provides the data corresponding to " turn on corresponding recommendation video and the content of upgrading is sent to TV A and mobile phone B "; The beginning of the screen on the response panel computer C/stop the operation such as grade, video reproduction program provides the data corresponding to " begin/stop the video of current broadcast and the content of upgrading is sent to TV A ".
As shown in Figure 6, for the present invention goes back the another kind of image processing apparatus 600 of embodiment, the specific embodiment of the invention is not done restriction to the specific implementation of image processing apparatus 600.As shown in Figure 6, this device can comprise:
Processor (processor) 610, communication interface (Communications Interface) 620, storer (memory) 630 and communication bus 640.Wherein:
Processor 610, communication interface 620 and storer 630 are finished mutual communication by communication bus 640.
Communication interface 620 is used for and net element communication such as client etc.
Processor 610 is used for executive routine 632, specifically can carry out the correlation step in the above-mentioned embodiment of the method shown in Figure 1.
Particularly, program 632 can comprise program code, and described program code comprises computer-managed instruction.
Processor 610 may be a central processor CPU, or specific integrated circuit ASIC(Application Specific Integrated Circuit), or be configured to implement one or more integrated circuit of the embodiment of the invention.
Storer 630 is used for depositing program 632.Storer 630 may comprise the high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 632 specifically can comprise:
Rendering module is used for according to current split screen instruction the data that the application program of local runtime provides being rendered into auxiliary storage;
Processing module is used for sending demonstration data corresponding in the described auxiliary storage according to current split screen instruction to corresponding target screen; And
The input mapping block is used for demonstration output and the mutual input of each target screen are mapped to described auxiliary storage.
The specific implementation of each unit can referring to the corresponding units in embodiment illustrated in fig. 2, be not repeated herein in the program 632.The those skilled in the art can be well understood to, and is the convenience described and succinct, and the specific works process of the equipment of foregoing description and module can be described with reference to the corresponding process among the preceding method embodiment, does not repeat them here.
Those of ordinary skills can recognize, unit and the method step of each example of describing in conjunction with embodiment disclosed herein can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.The professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds scope of the present invention.
If described function realizes with the form of SFU software functional unit and during as independently production marketing or use, can be stored in the computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in the storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out all or part of step of the described method of each embodiment of the present invention.And aforesaid storage medium comprises: the various media that can be program code stored such as USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD.
Above embodiment only is used for explanation the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; in the situation that does not break away from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.

Claims (24)

1. an image processing method is characterized in that, described method comprises step:
According to current split screen instruction the data that the application program of local runtime provides are rendered into auxiliary storage;
Send demonstration data corresponding in the described auxiliary storage according to current split screen instruction to corresponding target screen; And
Demonstration output and the mutual input of each target screen are mapped to described auxiliary storage.
2. method according to claim 1 is characterized in that, described method also comprises step:
Receive the split screen instruction;
Set up auxiliary storage according to the split screen instruction that receives.
3. method according to claim 2 is characterized in that, described split screen instruction comprises the resolution of each target screen;
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Resolution according to described each target screen is set up auxiliary storage.
4. method according to claim 2 is characterized in that, described split screen instruction comprises the corresponding relation that shows data and each target screen;
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Corresponding relation according to described demonstration data and each target screen is set up auxiliary storage.
5. method according to claim 2 is characterized in that, described split screen instruction comprises the resolution of each target screen and the corresponding relation that shows data and each target screen;
Set up in the step of auxiliary storage in the split screen instruction that described basis receives:
Set up auxiliary storage according to the resolution of described each target screen and the corresponding relation of demonstration data and each target screen.
6. each described method according to claim 1-5, it is characterized in that, comprise the resolution of each target screen and the corresponding relation that shows data and each target screen in the described split screen instruction, and the corresponding relation of the resolution of described each target screen and demonstration data and each target screen obtains by user's input and/or from this locality.
7. method according to claim 1 is characterized in that, the step that the described data that the application program of local runtime provided according to current split screen instruction are rendered into auxiliary storage comprises:
The data that the application program of local runtime is provided are rendered into auxiliary storage; And
Set up the mapping relations between the main storage area of described auxiliary storage and each target screen.
8. method according to claim 1 is characterized in that, comprises the corresponding relation that shows data and each target screen in the described split screen instruction;
Describedly comprise to the step that corresponding target screen sends in the described auxiliary storage corresponding demonstration data according to current split screen instruction:
According to the corresponding relation that shows data and each target screen, choose corresponding demonstration data;
Demonstration data to described correspondence are processed;
Demonstration data after the target screen transmission processing of correspondence.
9. method according to claim 8 is characterized in that, comprises the resolution of each target screen in the described split screen instruction;
The described step that the demonstration data of described correspondence are processed comprises:
Resolution according to demonstration data corresponding to the resolution adjustment of target screen.
10. method according to claim 7 is characterized in that, described main storage area is used for storage corresponding to the demonstration data of the demonstration of target screen.
11. method according to claim 1 is characterized in that, described auxiliary storage is used for the read-write operation object as local application.
12. each described method is characterized in that according to claim 1-11, described target screen comprises local display screen.
13. an image processing apparatus is characterized in that, described device comprises:
Rendering module is used for according to current split screen instruction the data that the application program of local runtime provides being rendered into auxiliary storage;
Processing module is used for sending demonstration data corresponding in the described auxiliary storage according to current split screen instruction to corresponding target screen; And
The input mapping block is used for demonstration output and the mutual input of each target screen are mapped to described auxiliary storage.
14. device according to claim 13 is characterized in that, described device also comprises:
Receiver module is used for receiving the split screen instruction;
Auxiliary storage is set up module, is used for setting up auxiliary storage according to the split screen instruction that described receiver module receives.
15. device according to claim 14 is characterized in that, described split screen instruction comprises the resolution of each target screen;
Described auxiliary storage is set up module and is set up auxiliary storage according to the resolution of described each target screen.
16. device according to claim 14 is characterized in that, described split screen instruction comprises the corresponding relation that shows data and each target screen;
Described auxiliary storage is set up module and is set up auxiliary storage according to the corresponding relation of described demonstration data and each target screen.
17. device according to claim 14 is characterized in that, described split screen instruction comprises the resolution of each target screen and the corresponding relation that shows data and each target screen;
Described auxiliary storage is set up module and is set up auxiliary storage according to the corresponding relation of the resolution of described each target screen and demonstration data and each target screen.
18. each described device according to claim 13-17, it is characterized in that, comprise the resolution of each target screen and the corresponding relation that shows data and each target screen in the described split screen instruction, and the corresponding relation of the resolution of described each target screen and demonstration data and each target screen obtains by user's input and/or from this locality.
19. device according to claim 13 is characterized in that, described rendering module comprises:
Rendering unit, the data that provide for the application program with local runtime are rendered into auxiliary storage; And
The output map unit is for the mapping relations between the main storage area of setting up described auxiliary storage and each target screen.
20. device according to claim 13 is characterized in that, comprises the corresponding relation that shows data and each target screen in the described split screen instruction;
Described processing module comprises:
Data selecting unit is used for choosing corresponding demonstration data according to the corresponding relation that shows data and each target screen;
Processing unit is used for the demonstration data of described correspondence are processed;
Transmitting element is for the demonstration data after the target screen transmission processing of correspondence.
21. device according to claim 20 is characterized in that, comprises the resolution of each target screen in the described split screen instruction;
Described processing unit is according to the resolution of demonstration data corresponding to the resolution adjustment of target screen.
22. device according to claim 19 is characterized in that, described main storage area is used for storage corresponding to the demonstration data of the demonstration of target screen.
23. device according to claim 13 is characterized in that, described auxiliary storage is used for the read-write operation object as local application.
24. each described device is characterized in that according to claim 13-23, described target screen comprises local display screen.
CN201310268258.5A 2013-06-28 2013-06-28 Image processing method and device Active CN103365621B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310268258.5A CN103365621B (en) 2013-06-28 2013-06-28 Image processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310268258.5A CN103365621B (en) 2013-06-28 2013-06-28 Image processing method and device

Publications (2)

Publication Number Publication Date
CN103365621A true CN103365621A (en) 2013-10-23
CN103365621B CN103365621B (en) 2016-10-05

Family

ID=49367073

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310268258.5A Active CN103365621B (en) 2013-06-28 2013-06-28 Image processing method and device

Country Status (1)

Country Link
CN (1) CN103365621B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104656873A (en) * 2013-11-25 2015-05-27 联想(北京)有限公司 Information processing method and electronic device
CN104717543A (en) * 2015-02-28 2015-06-17 深圳市中兴移动通信有限公司 Method and device for achieving interactive operation between different split screens
CN106527885A (en) * 2016-09-29 2017-03-22 京能世纪物联网技术(北京)有限公司 Screen display method and device for monitoring equipment
US9832342B2 (en) 2014-08-22 2017-11-28 Xiaomi Inc. Method and device for transmitting image
CN107483854A (en) * 2017-08-30 2017-12-15 深圳创维-Rgb电子有限公司 A kind of multi-display method and multi-screen television set
CN107908380A (en) * 2017-10-31 2018-04-13 厦门海为科技有限公司 Multi-display method, device, terminal device and storage medium based on configuration
CN108399039A (en) * 2018-02-09 2018-08-14 北京硬壳科技有限公司 A kind of large-size screen monitors control method and device
CN110018804A (en) * 2019-04-12 2019-07-16 京东方科技集团股份有限公司 A kind of display device, image display method and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101404151A (en) * 2008-08-04 2009-04-08 广东威创视讯科技股份有限公司 Multi-screen splicing apparatus and method
US20110209097A1 (en) * 2010-02-19 2011-08-25 Hinckley Kenneth P Use of Bezel as an Input Mechanism
CN102185884A (en) * 2011-03-18 2011-09-14 北京易视腾科技有限公司 Multi-screen interaction method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101404151A (en) * 2008-08-04 2009-04-08 广东威创视讯科技股份有限公司 Multi-screen splicing apparatus and method
US20110209097A1 (en) * 2010-02-19 2011-08-25 Hinckley Kenneth P Use of Bezel as an Input Mechanism
CN102185884A (en) * 2011-03-18 2011-09-14 北京易视腾科技有限公司 Multi-screen interaction method and system

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104656873A (en) * 2013-11-25 2015-05-27 联想(北京)有限公司 Information processing method and electronic device
CN104656873B (en) * 2013-11-25 2018-02-27 联想(北京)有限公司 A kind of information processing method and electronic equipment
US9832342B2 (en) 2014-08-22 2017-11-28 Xiaomi Inc. Method and device for transmitting image
CN104717543A (en) * 2015-02-28 2015-06-17 深圳市中兴移动通信有限公司 Method and device for achieving interactive operation between different split screens
CN106527885A (en) * 2016-09-29 2017-03-22 京能世纪物联网技术(北京)有限公司 Screen display method and device for monitoring equipment
CN107483854A (en) * 2017-08-30 2017-12-15 深圳创维-Rgb电子有限公司 A kind of multi-display method and multi-screen television set
CN107483854B (en) * 2017-08-30 2020-09-08 深圳创维-Rgb电子有限公司 Multi-screen display method and multi-screen television
CN107908380A (en) * 2017-10-31 2018-04-13 厦门海为科技有限公司 Multi-display method, device, terminal device and storage medium based on configuration
CN107908380B (en) * 2017-10-31 2021-04-16 厦门海为科技有限公司 Configuration-based multi-screen display method and device, terminal equipment and storage medium
CN108399039A (en) * 2018-02-09 2018-08-14 北京硬壳科技有限公司 A kind of large-size screen monitors control method and device
CN110018804A (en) * 2019-04-12 2019-07-16 京东方科技集团股份有限公司 A kind of display device, image display method and electronic equipment

Also Published As

Publication number Publication date
CN103365621B (en) 2016-10-05

Similar Documents

Publication Publication Date Title
CN103365621A (en) Image processing method and device
CN111651116B (en) Split screen interaction method, electronic equipment and computer storage medium
CN107908472A (en) Data synchronization unit, method and computer-readable recording medium
CN109643241A (en) Display processing method, device, storage medium and electric terminal
CN102707866A (en) Method and apparatus for navigating a hierarchical menu based user interface
CN105493032A (en) Cross-device user interface selection
CN103460177A (en) Gesture visualization and sharing between electronic devices and remote displays
US20140108909A1 (en) Graceful degradation of level-of-detail in document rendering
CN107272994A (en) Form interface switching
CN105493025A (en) Method and system for presenting content
CN104903830A (en) Display device and method of controlling the same
CN102073670B (en) Method, equipment and system for debugging online webpage template
CN103135879B (en) Display packing, display device and electronic equipment
CN103281580A (en) Television set remote control method for separating user interface and system thereof
CN103813126A (en) Method of providing information-of-users' interest when video call is made, and electronic apparatus thereof
CN107193593A (en) A kind of upgrade method, set top box and the storage medium of scalable file
CN106649639A (en) Page display method and device
CN102053871A (en) Application program image display method and device
KR20120045152A (en) Contents service system, contents creating service apparatus and method based on template, and terminal unit thereof
CN109460233A (en) Primary interface display update method, device, terminal device and the medium of the page
CN102511169B (en) Video reproduction apparatus, and control method thereof
CN103914213A (en) Method and device for eliminating page dithering
CN105453014A (en) Adjustable video player
CN103248919A (en) IPTV (Internet Protocol Television) system
CN108459781A (en) Input frame shows control method, device and user terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant