CN104202677A - Multi-screen display and control method and multi-screen display and control device supportive to multi-window applications - Google Patents
Multi-screen display and control method and multi-screen display and control device supportive to multi-window applications Download PDFInfo
- Publication number
- CN104202677A CN104202677A CN201410465581.6A CN201410465581A CN104202677A CN 104202677 A CN104202677 A CN 104202677A CN 201410465581 A CN201410465581 A CN 201410465581A CN 104202677 A CN104202677 A CN 104202677A
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- far
- display
- user
- end intelligent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a multi-screen display and control method supportive to multi-window applications. The multi-screen display and control method supportive to the multi-window applications includes that a television acquires display position instructions of window applications; the television merges content of all windows with display positions being at an identical far-end intelligent terminal and sends a merging result to the corresponding far-end intelligent terminal for display; the television merges content of all windows with display positions being in the local and displays a merging result on a television screen; the television receives a user operation type and operation position information fed back from an optional far-end intelligent terminal and determines the applications operated by a user and operation content for response according to the received information and the content merging result of all the windows sent to the far-end intelligent terminal; the television receives operation information executed by the user and determines the applications operated by the user and the operation content for response according to the information and the content merging result of all the windows displayed on the current television screen. The multi-screen display and control method supportive to the multi-window applications is capable of displaying and controlling multiple different windows at the same time.
Description
Technical field
The application relates to the Display Technique of intelligent television, particularly supports the multihead display of multiwindow application and the method and apparatus of control.
Background technology
The development of intelligent television and smart mobile phone at present, obviously show very large gap, the development of smart mobile phone is very quick, various interactive application based on smart mobile phone are also rich and varied, user can be the video on mobile phone, picture etc. is directly presented on the TV that screen is larger and watches, better share with other people, current technology is also divided for a variety of, DLNA, the AirPlay of apple, the Miracast that Wifi alliance formulates, especially after both, except can be conventional content of multimedia, outside projecting on TV and to show by wifi, also can accomplish mirroring image feature completely, exactly can be any interface showing on mobile phone screen, intact projecting on video screen, so just can provide and more enrich interesting experience, such as playing games, mobile phone is just equivalent to a handle, and TV is exactly display screen.Therefore, interconnected from mobile phone terminal to TV end is shown as for the focus of innovation area at present, millet box, the chromecast of google, dongle of Samsung etc. equipment, can realize realize very easily mobile phone to TV to mirror cast.But the development of intelligent television also slowly starts speed-raising, Zhe Kuai manor, parlor also starts to be subject to the attention of lots of manufacturers, millet TV, happy TV etc. producer of looking is also constantly releasing competitive intelligent television, TV is except traditional TV programme is play, almost can do anything that smart mobile phone end can do, it is very powerful and complicated that function becomes, but remote controller has been controlled to its a natural drawback.
Television set utilizes its large-screen, in the time of broadcast program, there is natural advantage, but also just because of its large-screen and high-resolution, cause some application program can take in use a lot of memory sources, and this is for current TV hardware, to be a very large bottleneck place, for example, while going to browse common webpage in the browser of intelligent television, shared memory source is than many many of the mobile phone of the small screen, and in the current stage taking remote controller as main mode of operation, operate extremely inconvenient, when selecting and input, need to move one by one with directionkeys, with respect to the mode of operation of touch-screen on current mobile phone, experience is great difference in social standing only not.
Simultaneously, on current intelligent television, window shows it is single window substantially, can not have multiple windows to show simultaneously, it is at most also Overlapping display, user can only see top that window, can not watch simultaneously and operate two windows, such as in watching a TV programme, if recall program guide EPG, that first will close current programme displaying window, and then display interface menu window, and can not accomplish that multiple windows show simultaneously and control simultaneously.
At present there are some solutions to realize interconnecting of mobile phone and TV Room, all to rely on WIFI network, carry out synchronous and control TV by mobile phone, but be all to realize long-range control in the various controlling application programs of the special exploitation of mobile phone terminal, and content synchronization show that major part is all based on whole display screen.For example,
Summary of the invention
The application provides a kind of multihead display and control method of supporting multiwindow application, can show simultaneously and control respectively different window application.
For achieving the above object, the application adopts following technical scheme:
Multihead display and a control method of supporting multiwindow application, comprising:
TV obtains the display position instruction of each window application; Wherein, described display position is arbitrary far-end intelligent terminal local or that connect with described TV;
Each windows content that described TV is same far-end intelligent terminal by display position synthesizes, and will synthesize result and send to corresponding far-end intelligent terminal to show; Be that local each windows content synthesizes by display position, and will synthesize result and show on video screen;
User's action type and the operating position information of arbitrary far-end intelligent terminal feedback described in described television reception, according to the information receiving and the synthetic result of the each windows content that sends to this far-end intelligent terminal, determine that application program and content of operation that user operates respond; The operation information that described television reception user carries out, according to the synthetic result of the each windows content showing on this information and TV screen, determines that application program and content of operation that user operates respond.
Preferably, described user's action type is for to touch, to click, zoom in or out; Described operating position information is coordinate information;
Application program and the content of operation of described definite user operation comprise: determine operated project in application program that user operates and this application program according to described coordinate information and the synthetic result of each windows content;
Described response comprises: according to user's action type, determine the operation of application programs and the operated project implementation, and carry out the response corresponding with this operation.
Preferably, when described TV responds the application program of user's operation, if described response is the processing to application, on the display position of application, show response results; If described response is the processing to other application programs, on the display position of these other application programs, show response results.
Preferably, before each windows content that described TV is same far-end intelligent terminal by display position synthesizes, according to the resolution of respective distal end intelligent terminal, carry out the interface layout of each window application.
Preferably, the display position instruction that described TV obtains window application comprises: after the application start instruction that television reception sends to user, prompting user selects display position, and receives the display position of user's input; Or TV is starting when application program, the display position that the display position that during using last application program launching, user selects ought last time start as this application program; Or the display position that system default is arranged is as the display position of application program.
Preferably, when described television reminding user selects display position, each far-end intelligent terminal and TV this locality of connecting with described TV are listed with tabular form, select for user.
Preferably, described TV is the synthetic result of each windows content of same far-end intelligent terminal by display position, sends to described far-end intelligent terminal after compression coding.
Preferably, arbitrary window application display position in single running is constant.
Preferably, described TV is connected with the WIFI that is connected to of arbitrary far-end intelligent terminal.
Multihead display and a control method of supporting multiwindow application, comprising:
The arbitrary far-end intelligent terminal connecting with TV receives the synthetic result of windows content that described TV is sent, and shows at this far-end intelligent terminal;
Described arbitrary far-end intelligent terminal receives the operation of user's input, and action type and operating position information are sent to described TV.
Preferably, described arbitrary far-end intelligent terminal receives after described synthetic result, according to the resolution of synthetic result and self display screen, described synthetic result is carried out to resolution adjustment, and the result after adjusting is shown at the display screen of described arbitrary far-end intelligent terminal.
Preferably, described operating position information is sent to before described TV, described arbitrary far-end intelligent terminal, according to the described resolution adjustment that synthetic result is carried out, is converted to the operating position information corresponding with described synthetic result resolution by described operating position information.
Preferably, described arbitrary far-end intelligent terminal receives the synthetic result of windows content that described TV sends and comprises: described arbitrary far-end intelligent terminal receives the signal that TV is sent, and carries out obtaining the synthetic result of described windows content after verification, decompression and decoding.
Multihead display and a control device of supporting multiwindow application, comprising: display position determining unit, windows content synthesis unit, display unit, virtual display, transmission unit and program response unit;
Described display position determining unit, for obtaining the display position instruction of each window application; Wherein, described display position is arbitrary far-end intelligent terminal local or that connect with described TV;
Described windows content synthesis unit, for being that each windows content of same far-end intelligent terminal synthesizes by display position, and will synthesizing result and send to corresponding virtual display; Be that local each windows content synthesizes by display position, and will synthesize result and send to described display unit;
Described virtual display, for managing display position in the synthetic result of each window of same far-end intelligent terminal, and is transferred to corresponding far-end intelligent terminal by described transmission unit and shows; Also for described synthetic result is offered to described program response unit;
Described display unit, shows for the synthetic result that described windows content synthesis unit is sent, and the synthetic result showing is offered to described program response unit;
Described transmission unit, for connecting with arbitrary far-end intelligent terminal, receives user's action type and the operating position information of arbitrary far-end intelligent terminal feedback, and offers described program response unit;
Described program response unit, the synthetic result of each window of the response far-end intelligent terminal providing for arbitrary far-end intelligent terminal feedack of providing according to described transmission unit and described virtual display, determines that application program and content of operation that user operates respond; The operation information of also carrying out for receiving user, the synthetic result providing according to this information and described display unit, determines that application program and content of operation that user operates respond.
Multihead display and a control device of supporting multiwindow application, comprising: transmission unit, display unit and user interaction unit;
Described transmission unit, for connecting with TV, receives the synthetic result of windows content that described TV is sent, and offers described display unit; Also send to described TV for action type and operating position information that described user interaction unit is provided;
Described display unit, shows for the synthetic result of windows content that described transmission unit is provided;
Described user interaction unit, for receiving the operation of user input, and extracts action type and operating position information sends to described transmission unit.
Preferably, this device further comprises resolution adaptation module, for the synthetic resolution of result of windows content and the resolution of described display unit that receive according to described transmission unit, the synthetic result that described transmission unit is provided is carried out resolution adjustment, and the result after adjusting is sent to described display unit; Also, for according to the described resolution adjustment that synthetic result is carried out, the operating position information of user interaction unit extraction is converted to the operating position information corresponding with described synthetic result resolution, offers described transmission unit and send to described TV.
As seen from the above technical solution, in the application, TV is according to the display position instruction of each window application, be to show at local video screen after local each windows content synthesizes by display position, after the each windows content that is far-end intelligent terminal by display position merges, on the screen of intelligent terminal, show, thereby show different window application simultaneously on distinct device.Meanwhile, user's action type and the operating position information of television reception intelligent terminal feedback, determine according to this operating position the application program that user operates, and user responded the operation of this application program; TV can also receive the operation of user to the application program showing on local video screen, and responds.Like this, user's operation that just can receive by distinct device, and different windows application program is responded simultaneously.
Brief description of the drawings
Fig. 1 is the method flow schematic diagram of multihead display and control in the application;
Fig. 2 is the example schematic diagram one of the application's application scenarios;
Fig. 3 is the example schematic diagram two of the application's application scenarios.
Embodiment
In order to make the application's object, technological means and advantage clearer, below in conjunction with accompanying drawing, the application is described in further details.
If can be in not affecting current television program broadcasting, provide another one window to remove to browse other contents of program such as EPG to user, for example carrying out program checks, treat that user has really selected other channels to switch in the past again, it will be a kind of better experience, if it can be projected on the screen of mobile phone, do not cover or take the screen of TV, selection and the control of TV programme are also carried out in touch operation by mobile phone, allowing video screen mainly be responsible for program plays, mobile phone is brought in responsible control, a point defection is like this Interactive Experience of a kind of good mobile phone and TV.
Based on above-mentioned thinking, the application proposes a kind of multihead display and control method, utilize TV and connected far-end intelligent terminal to carry out the content demonstration of different application, and corresponding application program is separated to control, thereby realize the object of simultaneously controlling different application.
In multihead display and control method that the application provides, comprise the processing of TV side and the processing of far-end intelligent terminal side.For convenience of description, below by the mode of TV and far-end intelligent terminal interactive, the application's method is described.Fig. 1 is the basic procedure schematic diagram of multihead display and control method in the application.As shown in Figure 1, the method comprises:
Step 101, TV obtains the display position instruction of each window application.
Wherein, certain far-end intelligent terminal that display position can connect for this locality or with TV.Being connected between TV and far-end intelligent terminal can be WIFI etc., and the concrete mode of concrete discovering device and connection is identical with existing mode, just repeats no more here.
TV obtains the instruction of application program display position, can be in the time receiving the application start instruction that user sends, prompting user inputs display position, specifically all possible display position can be shown to user with tabular form, wherein can comprise local and all far-end intelligent terminals that connected with TV.The display position the corresponding application program that receive user's input are carried out record.Or, also can provide memory that function is set, preserve display position preservation that user selects for application program, in the time that start same application domain next time, the display position that when display position of directly definite application program started with last time, user selects is identical, thereby do not need user all to select display position at every turn, user-friendly.Or, for the hommization more using, can also be in system the display position of default setting application program, for example default setting is that far-end intelligent terminal shows, only, in the time not having far-end intelligent terminal and TV to connect, just select local display application program.
Step 102, TV synthesizes each windows content identical display position; Be the windows content of far-end intelligent terminal for display position, will synthesize result and send to corresponding far-end intelligent terminal; Be local windows content for display position, will synthesize result and show on video screen.
The windows content of the each application program starting of television reception is prepared to show.First, determine the display position of each windows content, then, each windows content identical display position is synthesized, the concrete processing mode of synthesis window content is identical with existing mode, just repeats no more here.
After windows content is synthetic, the windows content showing for this locality, will synthesize result and directly on video screen, show.Like this, user can see by video screen the displaying contents of this class application program.Be the windows content of certain far-end intelligent terminal for display position, will synthesize result and send to corresponding far-end intelligent terminal to show.Here, the far-end intelligent terminal being connected with TV may, for multiple, for the windows content of each far-end intelligent terminal, synthesize respectively and transmit.Like this, user can see by the screen of far-end intelligent terminal the displaying contents of this class application program.Through above-mentioned processing, user can utilize different display device (video screen and far-end intelligent terminal) to watch different application content.Wherein, TV will synthesize result to be issued before far-end intelligent terminal, preferably, will synthesize result encode and compress after transmit, and corresponding transmission rate is set according to actual needs.Connect for WIFI, can transmit with the speed of 30 frames per second.For realizing better the management of the windows content to issuing far-end intelligent terminal, can in TV, increase virtual display module, for managing the window data that is shown to far-end intelligent terminal.
In addition, be the different resolution of the different far-end intelligent terminals of adaptation and TV, preferably, can, before windows content is synthesized, according to the resolution of far-end intelligent terminal, carry out the interface layout of respective window application program, make interface display more perfect.
Step 103, far-end intelligent terminal receives the windows content after synthetic that TV sends, and directly on display screen, shows.
If the windows content that TV is sent after synthetic is through coding and compression, far-end intelligent terminal receives after corresponding data, and the processing that first decompresses and decode, then shows windows content after treatment.
In addition, preferably, be the different resolution of adaptive far-end intelligent terminal and TV, far-end intelligent terminal is after the window data receiving after synthesizing, can extract resolution information, and the window data after synthetic is carried out to resolution adjustment, then the result after adjusting is shown.
Step 104, far-end intelligent terminal receives the operation of user's input, and action type and operating position information are returned to TV.
Intelligent terminal receives the operation of user on display screen, and read operation position and action type do not need operation to resolve, and directly operating position and action type are sent to TV.For example, show screen display EPG, carried out and touch operation on certain channel that user shows at EPG, intelligent terminal directly sends to TV by touch operation and touch location, and does not need to parse the information of " user has selected certain channel ".Therefore, do not need with TV in the special processing unit that adapts of application program, only utilize the existing capability of intelligent terminal operating system can realize the extraction of action type and operating position information.Wherein, action type can be the operation such as to touch, click, zoom in or out.
In addition, if carried out the adjustment of resolution in step 103,, before transmit operation positional information, need to operating position information be converted into the operating position information corresponding with the synthetic result resolution of window according to the adjustment of resolution.Conventionally, operating position information can be coordinate information, needs to carry out Coordinate Conversion, converts the coordinate that the resolution of the synthetic content of the window sent with TV adapts to.
Step 105, action type and the operating position information of television reception far-end intelligent terminal feedback, according to this information and the synthetic result of the each windows content that sends to this far-end intelligent terminal, determine application program and content of operation that user operates, and respond.
After television reception action type and operating position information, in the synthetic result of each windows content of issuing far-end intelligent terminal, determine according to operating position information the application program that user operates, and give corresponding application program by action type and operating position information and process.The application program of determining is carried out event handling and response according to action type and operating position information, complete the operation of anticipation, such as user is on the display screen of far-end intelligent terminal on shown EPG, click a program button, corresponding information returns to after TV so, that first TV determines according to operating position information that user operates is EPG, EPG is according to clicking operation and click location, determine that user has clicked program button, user's clicking operation is responded, will start to play the program of choosing.
From above-mentioned, operation for user to application program shown on intelligent terminal, remain by TV it is responded, therefore, the operation of supporting for application program itself can respond, if user has carried out the operation that the application program of TV cannot respond on intelligent terminal, this operation is without response.
Step 106, the operation information of television reception user to shown application program on tv display screen, according to the synthetic result of the each windows content showing on this information and video screen, determines application program and operation that user operates, responds.
For the synthetic result of the each windows content showing on video screen, user can utilize TV remote controller etc. to operate.Television reception user's operation information, responds user's operation according to existing processing mode.Particularly, according to the synthetic content of the each window showing on video screen, determine the application program that user operates, and read operation content, by corresponding application program, user is operated and responded.
The operation of above-mentioned steps 104～105 has realized the operation response of user to the application program showing on far-end intelligent terminal, and the operation of step 106 has realized the operation response of user to the local application program showing of TV.This two-part operation and response can be carried out simultaneously, thereby realize the user's operation to different application and control simultaneously.
In addition, in above-mentioned steps 105 and 106, when application program is carried out operation response, if this response is the processing to application, on the display position of application, show response results; If this response is the processing to other application programs, on the display position of these other application programs, show response results.For example, on intelligent terminal, show EPG, on TV, show the program of current broadcasting; If user has selected a program in EPG on intelligent terminal screen, the response of this operation is to play the program of choosing, and on video screen, plays the program that user chooses by intelligent terminal; If user selects to open lower one page of the current EPG page on intelligent terminal screen, the response of this operation is to show lower one page of EPG, in lower one page content of the demonstration screen display EPG of intelligent terminal.Therefore, preferably, arbitrary window application display position in single running is constant.In the time that reopen application program next time, can reselect display position.
So far, the method flow in the application finishes.In said method flow process, step 101, step 102, step 105 and step 106 form the handling process of TV side, and step 103 and step 104 form the handling process of far-end intelligent terminal side.
The application also provides multihead display and control device, can be for implementing the method flow shown in above-mentioned Fig. 1.Wherein, the multihead display and the control device that are arranged in TV comprise: display position determining unit, windows content synthesis unit, display unit, virtual display, transmission unit and program response unit.
In this device, display position determining unit, for obtaining the display position instruction of each window application; Wherein, display position is arbitrary far-end intelligent terminal local or that connect with TV.Windows content synthesis unit, for being that each windows content of same far-end intelligent terminal synthesizes by display position, and will synthesizing result and send to corresponding virtual display; Be that local each windows content synthesizes by display position, and will synthesize result and send to display unit.Virtual display, for managing display position in the synthetic result of each window of same far-end intelligent terminal, and is transferred to corresponding far-end intelligent terminal by transmission unit and shows; Also offer program response unit for synthesizing result.Display unit, shows for the synthetic result that windows content synthesis unit is sent, and the synthetic result showing is offered to program response unit.Transmission unit, for connecting with arbitrary far-end intelligent terminal, receives user's action type and the operating position information of arbitrary far-end intelligent terminal feedback, and offers program response unit.Program response unit, the synthetic result of each window of the response far-end intelligent terminal providing for arbitrary far-end intelligent terminal feedack of providing according to transmission unit and virtual display, determines that application program and content of operation that user operates respond; The operation information of also carrying out for receiving user, the synthetic result providing according to this information and display unit, determines that application program and content of operation that user operates respond.
Multihead display and the control device of what the application provided be arranged in far-end intelligent terminal comprise: transmission unit, display unit and user interaction unit.
In this device, transmission unit, for connecting with TV, receives the synthetic result of windows content that described TV is sent, and offers display unit; Also send to TV for action type and operating position information that user interaction unit is provided.Display unit, shows for the synthetic result of windows content that transmission unit is provided.User interaction unit, for receiving the operation of user input, and extracts action type and operating position information sends to transmission unit.
In addition, preferably, this device can further include resolution adaptation module, for the synthetic resolution of result of windows content and the resolution of described display unit that receive according to transmission unit, the synthetic result that transmission unit is provided is carried out resolution adjustment, and the result after adjusting is sent to described display unit; Also, for according to the resolution adjustment that synthetic result is carried out, the operating position information of user interaction unit extraction is converted to the operating position information corresponding with synthesizing result resolution, offers transmission unit and send to TV.
Provide a practical application scene below, the application's advantage is described.
As shown in Figures 2 and 3, user is utilizing video screen to watch a TV programme, but he wants again to look at whether other channels have other TVs to see, according to the technical scheme in background technology, generally there are two kinds: 1. turn off current TV programme broadcast program, recall full frame program guide, go one by one to check and the TV programme of other channels of preview by the directionkeys of remote controller, if chosen, then switching telegram in reply is looked broadcast interface; 2. ejecting one in current broadcast interface suspension is not full frame OSD (on-screen display), select for user, if but this OSD size is very large, that can cover the picture of playing below substantially, if very little, the amount of information of that demonstration can be restricted, can not show that comparatively detailed channel program information is to user, such as near the channel that can only show a few, the programme information that each channel shows also can be little, may be exactly a simple program title.Above-mentioned two kinds of modes, all can there be such-and-such problem user's experience aspect.
But, adopt the application's processing scheme, full frame program guide can be projected on mobile phone, compared with the interface operation of remote controller, touch control operation can be convenient, do not affect in addition the current program watched and play, after waiting user fully to browse and selecting, then carry out the switching of channel on video screen on mobile phone yet.Can accomplish so better separation that content of TV program is play and controlled, can make full use of again mobile phone screen and touch the convenience operating.And if user does not want to be presented on mobile phone, as long as reselect display terminal, it can be presented on video screen again very easily, continues to control with remote controller, still can be switched to very easily original occupation mode and get on.
The large-screen of TV is its natural attribute, conveniently there is its natural advantage in displaying video content, but in the time of browsing page, just become a large drawback, especially when browsing page is not in order to see news, the use of amusement, and just select in order to complete entry necessary in Video-on-demand VOD process, input is mutual, when the operations such as account certification and authentication, the huge memory consumption bringing except large scale screen, outside the problems such as page loading velocity is slow, on the webpage of TV, carry out interactive operation, that can be the thing extremely bothering, it still needs to move one by one selection with the directionkeys of remote controller, if and these operations are all to complete on mobile phone, the relative TV of size of mobile phone screen, little a lot, the parsing of web page and be carried in internal memory and time loss aspect can be greatly improved, in addition, because application program is in fact still moved on TV, some accounts and the authentication information preserved on TV can directly be employed program use, and do not need by Internet Transmission to mobile phone, also just avoided the problem of important personal information transmission security.
From above-mentioned, the application is intended to realize the multiwindow multi-screen synchronous demonstration of intelligent television, any application program of exploitation on TV, can select to project on TV by shirtsleeve operation, or project on the intelligent mobile terminal equipment connecting with TV, simultaneous display with multiple windows of realizing multiple television applications on different screen, is independent of each other, and the display screen on current intelligent mobile terminal is just equivalent to the virtual distal displayed screen of a TV.If according to traditional windowing system, window synthesis module can synthesize according to the degree of depth of current all windows and hierarchical relationship, but in this application, newly add an attribute for each window in fact, be display screen id, if it is local display screen that this application program is selected, that still can proceed to synthesize, if application program is the different display screen id of non-local display screen, can carry out new synthesizing, the window that only belongs to same display screen just can synthesize, and then outputs on the display device of appointment.Although looking, program is presented on mobile terminal, but in fact it run on the platform of intelligent television, operable device resource is all the resource on TV, the operation of carrying out, all for television equipment, has just utilized the display screen of mobile terminal here.Between far-end intelligent terminal and TV, can use the connections such as wifi to communicate, so the window between equipment shows the passback of the control command of real-time data transmission and mobile phone terminal touch operation generation and can ensure aspect data transmission rate, do not have very large delay.The program window data of transmitting by connecting are actually the original window framebuffer data of comparison bottom, instead of various concrete multimedias or other data formats, can well shield like this otherness of upper level applications, do not need to develop the various various specific type of data that specifically should be used for resolving in intelligent terminal side yet, just as processing, local window framebuffer data are passable, and this is the function that current intelligent mobile terminal platform has possessed.
Thus, the application's processing scheme has adopted on intelligent television platform, window based on each application program manages, can project on the mobile terminal device connecting with TV, the multi-screen synchronous of having realized based on window rank shows, make mobile terminal screen become effective expansion of tv display screen, utilize small size and the convenient touch operation of mobile terminal screen, experience when can greatly improving and enriching user and use intelligent television, make TV end bring into play greatly the pleasure of the senses that its large scale display brings, the convenient control mode that can utilize again mobile terminal touch control operation to bring.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any amendment of making, be equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.
Claims (16)
1. multihead display and a control method of supporting multiwindow application, is characterized in that, comprising:
TV obtains the display position instruction of each window application; Wherein, described display position is arbitrary far-end intelligent terminal local or that connect with described TV;
Each windows content that described TV is same far-end intelligent terminal by display position synthesizes, and will synthesize result and send to corresponding far-end intelligent terminal to show; Be that local each windows content synthesizes by display position, and will synthesize result and show on video screen;
User's action type and the operating position information of arbitrary far-end intelligent terminal feedback described in described television reception, according to the information receiving and the synthetic result of the each windows content that sends to this far-end intelligent terminal, determine that application program and content of operation that user operates respond; The operation information that described television reception user carries out, according to the synthetic result of the each windows content showing on this information and TV screen, determines that application program and content of operation that user operates respond.
2. method according to claim 1, is characterized in that, described user's action type is for to touch, to click, zoom in or out; Described operating position information is coordinate information;
Application program and the content of operation of described definite user operation comprise: determine operated project in application program that user operates and this application program according to described coordinate information and the synthetic result of each windows content;
Described response comprises: according to user's action type, determine the operation of application programs and the operated project implementation, and carry out the response corresponding with this operation.
3. method according to claim 1, is characterized in that, when described TV responds the application program of user's operation, if described response is the processing to application, on the display position of application, shows response results; If described response is the processing to other application programs, on the display position of these other application programs, show response results.
4. method according to claim 1, is characterized in that, before each windows content that described TV is same far-end intelligent terminal by display position synthesizes, according to the resolution of respective distal end intelligent terminal, carries out the interface layout of each window application.
5. method according to claim 1, it is characterized in that, the display position instruction that described TV obtains window application comprises: after the application start instruction that television reception sends to user, prompting user selects display position, and receives the display position of user's input; Or TV is starting when application program, the display position that the display position that during using last application program launching, user selects ought last time start as this application program; Or the display position that system default is arranged is as the display position of application program.
6. method according to claim 5, is characterized in that, when described television reminding user selects display position, each far-end intelligent terminal and TV this locality of connecting with described TV is listed with tabular form, selects for user.
7. according to arbitrary described method in claim 1 to 6, it is characterized in that, described TV is the synthetic result of each windows content of same far-end intelligent terminal by display position, sends to described far-end intelligent terminal after compression coding.
8. according to arbitrary described method in claim 1 to 6, it is characterized in that, arbitrary window application display position in single running is constant.
9. according to arbitrary described method in claim 1 to 6, it is characterized in that, described TV is connected with the WIFI that is connected to of arbitrary far-end intelligent terminal.
10. multihead display and a control method of supporting multiwindow application, is characterized in that, comprising:
The arbitrary far-end intelligent terminal connecting with TV receives the synthetic result of windows content that described TV is sent, and shows at this far-end intelligent terminal;
Described arbitrary far-end intelligent terminal receives the operation of user's input, and action type and operating position information are sent to described TV.
11. methods according to claim 10, it is characterized in that, described arbitrary far-end intelligent terminal receives after described synthetic result, according to the resolution of synthetic result and self display screen, described synthetic result is carried out to resolution adjustment, and the result after adjusting is shown at the display screen of described arbitrary far-end intelligent terminal.
12. methods according to claim 11, it is characterized in that, described operating position information is sent to before described TV, described arbitrary far-end intelligent terminal, according to the described resolution adjustment that synthetic result is carried out, is converted to the operating position information corresponding with described synthetic result resolution by described operating position information.
13. methods according to claim 10, it is characterized in that, described arbitrary far-end intelligent terminal receives the synthetic result of windows content that described TV sends and comprises: described arbitrary far-end intelligent terminal receives the signal that TV is sent, and carries out obtaining the synthetic result of described windows content after verification, decompression and decoding.
Support multihead display and the control device of multiwindow application for 14. 1 kinds, it is characterized in that, comprising: display position determining unit, windows content synthesis unit, display unit, virtual display, transmission unit and program response unit;
Described display position determining unit, for obtaining the display position instruction of each window application; Wherein, described display position is arbitrary far-end intelligent terminal local or that connect with described TV;
Described windows content synthesis unit, for being that each windows content of same far-end intelligent terminal synthesizes by display position, and will synthesizing result and send to corresponding virtual display; Be that local each windows content synthesizes by display position, and will synthesize result and send to described display unit;
Described virtual display, for managing display position in the synthetic result of each window of same far-end intelligent terminal, and is transferred to corresponding far-end intelligent terminal by described transmission unit and shows; Also for described synthetic result is offered to described program response unit;
Described display unit, shows for the synthetic result that described windows content synthesis unit is sent, and the synthetic result showing is offered to described program response unit;
Described transmission unit, for connecting with arbitrary far-end intelligent terminal, receives user's action type and the operating position information of arbitrary far-end intelligent terminal feedback, and offers described program response unit;
Described program response unit, the synthetic result of each window of the response far-end intelligent terminal providing for arbitrary far-end intelligent terminal feedack of providing according to described transmission unit and described virtual display, determines that application program and content of operation that user operates respond; The operation information of also carrying out for receiving user, the synthetic result providing according to this information and described display unit, determines that application program and content of operation that user operates respond.
Support multihead display and the control device of multiwindow application for 15. 1 kinds, it is characterized in that, comprising: transmission unit, display unit and user interaction unit;
Described transmission unit, for connecting with TV, receives the synthetic result of windows content that described TV is sent, and offers described display unit; Also send to described TV for action type and operating position information that described user interaction unit is provided;
Described display unit, shows for the synthetic result of windows content that described transmission unit is provided;
Described user interaction unit, for receiving the operation of user input, and extracts action type and operating position information sends to described transmission unit.
16. devices according to claim 15, it is characterized in that, this device further comprises resolution adaptation module, for the synthetic resolution of result of windows content and the resolution of described display unit that receive according to described transmission unit, the synthetic result that described transmission unit is provided is carried out resolution adjustment, and the result after adjusting is sent to described display unit; Also, for according to the described resolution adjustment that synthetic result is carried out, the operating position information of user interaction unit extraction is converted to the operating position information corresponding with described synthetic result resolution, offers described transmission unit and send to described TV.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410465581.6A CN104202677B (en) | 2014-09-12 | 2014-09-12 | Support the method and apparatus of the multihead display and control of multiwindow application |
| KR1020150099838A KR20160031403A (en) | 2014-09-12 | 2015-07-14 | A multiscreen control method and device supporting multiple window applications |
| EP15184625.0A EP2996346A1 (en) | 2014-09-12 | 2015-09-10 | Multi-screen control method and device supporting multiple window applications |
| US14/851,564 US9723123B2 (en) | 2014-09-12 | 2015-09-11 | Multi-screen control method and device supporting multiple window applications |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410465581.6A CN104202677B (en) | 2014-09-12 | 2014-09-12 | Support the method and apparatus of the multihead display and control of multiwindow application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104202677A true CN104202677A (en) | 2014-12-10 |
| CN104202677B CN104202677B (en) | 2018-10-16 |
Family
ID=52087892
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410465581.6A Active CN104202677B (en) | 2014-09-12 | 2014-09-12 | Support the method and apparatus of the multihead display and control of multiwindow application |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR20160031403A (en) |
| CN (1) | CN104202677B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105930464A (en) * | 2016-04-22 | 2016-09-07 | 腾讯科技（深圳）有限公司 | Web rich media multi-screen adaptation method and apparatus |
| CN105992069A (en) * | 2015-01-31 | 2016-10-05 | 乐视致新电子科技（天津）有限公司 | Browser control method and system, mobile device and television |
| CN107982915A (en) * | 2017-11-30 | 2018-05-04 | 杭州电魂网络科技股份有限公司 | More game are the same as screen implementation method and device |
| WO2018184442A1 (en) * | 2017-04-05 | 2018-10-11 | 博彦科技股份有限公司 | Terminal control method and device |
| CN108702412A (en) * | 2017-06-09 | 2018-10-23 | 华为技术有限公司 | A kind of display methods and device |
| WO2019192178A1 (en) * | 2018-04-02 | 2019-10-10 | 广州视源电子科技股份有限公司 | Screen transmission method and apparatus, electronic device, and computer-readable storage medium |
| CN110531870A (en) * | 2019-08-16 | 2019-12-03 | 北京小鸟科技股份有限公司 | KVM attends a banquet management system and mouse picking method |
| CN112511873A (en) * | 2020-11-12 | 2021-03-16 | 熊猫（北京）国际信息技术有限公司 | Multifunctional television |
| CN113691855A (en) * | 2021-08-11 | 2021-11-23 | 康佳集团股份有限公司 | Multi-window control processing method, device, terminal and medium based on smart television |
| CN114513535A (en) * | 2022-01-07 | 2022-05-17 | 阿里巴巴（中国）有限公司 | Data transmission system, method, device and equipment |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102386285B1 (en) | 2017-09-08 | 2022-04-14 | 삼성전자주식회사 | Method for controlling audio outputs by applications respectively through earphone and electronic device for the same |
| CN112584244B (en) * | 2020-12-14 | 2023-01-06 | 深圳创维－Rgb电子有限公司 | Application program locking method, smart television and computer storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101686380A (en) * | 2008-09-25 | 2010-03-31 | 索尼株式会社 | Information processing apparatus, information processing method, information processing system, and program |
| CN101815162A (en) * | 2010-04-27 | 2010-08-25 | 四川长虹电器股份有限公司 | System for remote control of programs |
| CN102223573A (en) * | 2011-05-27 | 2011-10-19 | 深圳市同洲电子股份有限公司 | Program association processing method in playing program and system thereof |
| CN102724579A (en) * | 2011-03-29 | 2012-10-10 | 深圳市同洲软件有限公司 | Display method, apparatus, and system for electronic program guide information |
| CN103780932A (en) * | 2012-10-17 | 2014-05-07 | Lg电子株式会社 | Mobile terminal, broadcasting terminal, and controlling method thereof |
-
2014
- 2014-09-12 CN CN201410465581.6A patent/CN104202677B/en active Active
-
2015
- 2015-07-14 KR KR1020150099838A patent/KR20160031403A/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101686380A (en) * | 2008-09-25 | 2010-03-31 | 索尼株式会社 | Information processing apparatus, information processing method, information processing system, and program |
| CN101815162A (en) * | 2010-04-27 | 2010-08-25 | 四川长虹电器股份有限公司 | System for remote control of programs |
| CN102724579A (en) * | 2011-03-29 | 2012-10-10 | 深圳市同洲软件有限公司 | Display method, apparatus, and system for electronic program guide information |
| CN102223573A (en) * | 2011-05-27 | 2011-10-19 | 深圳市同洲电子股份有限公司 | Program association processing method in playing program and system thereof |
| CN103780932A (en) * | 2012-10-17 | 2014-05-07 | Lg电子株式会社 | Mobile terminal, broadcasting terminal, and controlling method thereof |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105992069A (en) * | 2015-01-31 | 2016-10-05 | 乐视致新电子科技（天津）有限公司 | Browser control method and system, mobile device and television |
| CN105930464A (en) * | 2016-04-22 | 2016-09-07 | 腾讯科技（深圳）有限公司 | Web rich media multi-screen adaptation method and apparatus |
| WO2018184442A1 (en) * | 2017-04-05 | 2018-10-11 | 博彦科技股份有限公司 | Terminal control method and device |
| CN114168092A (en) * | 2017-06-09 | 2022-03-11 | 华为技术有限公司 | Display method and device |
| CN114185475A (en) * | 2017-06-09 | 2022-03-15 | 华为技术有限公司 | Display method and device |
| US11740851B2 (en) | 2017-06-09 | 2023-08-29 | Huawei Technologies Co., Ltd. | Display method and apparatus |
| US11372613B2 (en) | 2017-06-09 | 2022-06-28 | Huawei Technologies Co., Ltd. | Display method and apparatus |
| CN108702412A (en) * | 2017-06-09 | 2018-10-23 | 华为技术有限公司 | A kind of display methods and device |
| CN108702412B (en) * | 2017-06-09 | 2021-11-19 | 华为技术有限公司 | Display method, terminal and computer readable storage medium |
| US11068226B2 (en) | 2017-06-09 | 2021-07-20 | Huawei Technologies Co., Ltd. | Display method and apparatus |
| CN107982915A (en) * | 2017-11-30 | 2018-05-04 | 杭州电魂网络科技股份有限公司 | More game are the same as screen implementation method and device |
| CN107982915B (en) * | 2017-11-30 | 2020-10-16 | 杭州电魂网络科技股份有限公司 | Multi-game same-screen implementation method and device |
| WO2019192178A1 (en) * | 2018-04-02 | 2019-10-10 | 广州视源电子科技股份有限公司 | Screen transmission method and apparatus, electronic device, and computer-readable storage medium |
| CN110531870A (en) * | 2019-08-16 | 2019-12-03 | 北京小鸟科技股份有限公司 | KVM attends a banquet management system and mouse picking method |
| CN110531870B (en) * | 2019-08-16 | 2023-04-25 | 北京小鸟科技股份有限公司 | KVM seat management system and mouse positioning method |
| CN112511873A (en) * | 2020-11-12 | 2021-03-16 | 熊猫（北京）国际信息技术有限公司 | Multifunctional television |
| CN113691855A (en) * | 2021-08-11 | 2021-11-23 | 康佳集团股份有限公司 | Multi-window control processing method, device, terminal and medium based on smart television |
| CN114513535A (en) * | 2022-01-07 | 2022-05-17 | 阿里巴巴（中国）有限公司 | Data transmission system, method, device and equipment |
| CN114513535B (en) * | 2022-01-07 | 2024-03-08 | 阿里巴巴（中国）有限公司 | Data transmission system, method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20160031403A (en) | 2016-03-22 |
| CN104202677B (en) | 2018-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021212668A1 (en) | Screen projection display method and display device | |
| CN104202677A (en) | Multi-screen display and control method and multi-screen display and control device supportive to multi-window applications | |
| CN111405333B (en) | Display apparatus and channel control method | |
| US9723123B2 (en) | Multi-screen control method and device supporting multiple window applications | |
| CN111405376A (en) | Program language selection method and display device | |
| WO2021217435A1 (en) | Streaming media synchronization method and display device | |
| CN111726673B (en) | Channel switching method and display device | |
| CN111601142B (en) | Subtitle display method and display equipment | |
| CN111601144B (en) | Streaming media file playing method and display equipment | |
| CN111291238A (en) | Display device and search display method | |
| WO2021109490A1 (en) | Display device and channel control method | |
| CN113473194B (en) | Intelligent device and response method | |
| WO2021139045A1 (en) | Method for playing back media project and display device | |
| CN113115088B (en) | Control method of user interface of display equipment and display equipment | |
| CN113742609A (en) | Display device and method for guiding voice search function | |
| US12056418B2 (en) | Content-based voice output method and display apparatus | |
| CN111885415B (en) | Audio data rapid output method and display device | |
| CN113010074A (en) | Webpage Video control bar display method and display equipment | |
| CN113727162A (en) | Display device, server and character introduction display method | |
| CN113691852A (en) | Display device and media asset playing method | |
| CN111405329A (en) | Display device and control method for EPG user interface display | |
| CN112565892B (en) | Method for identifying roles of video programs and related equipment | |
| CN113542885B (en) | Display device, server and processing method for media asset search | |
| CN111901686B (en) | Method for keeping normal display of user interface stack and display equipment | |
| CN111601158B (en) | Method for optimizing audio track cutting of streaming media pipeline and display equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |