CN101416494A - Apparatus and method for identifying an application in the multiple screens environment - Google Patents
Apparatus and method for identifying an application in the multiple screens environment Download PDFInfo
- Publication number
- CN101416494A CN101416494A CNA2007800122149A CN200780012214A CN101416494A CN 101416494 A CN101416494 A CN 101416494A CN A2007800122149 A CNA2007800122149 A CN A2007800122149A CN 200780012214 A CN200780012214 A CN 200780012214A CN 101416494 A CN101416494 A CN 101416494A
- Authority
- CN
- China
- Prior art keywords
- screen
- service
- application
- logical
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
A method and apparatus for identifying an application in a multi-screen environment are provided. The apparatus includes a digital signal processing module which receives at least one of video information, audio information and data information, and restores a service based on the at least one of the video information, the audio information and the data information, a service processing module which generates a plurality of logical screens for displaying the restored service, and an output module which maps the plurality of logical screens provided by the service processing module to different locations on a display screen. An application present in the service is identified by a service context in which the application is executed and by identification inform.
Description
Technical field
The present invention relates to a kind of method and apparatus that is used in multiple screens environment identification application.
Background technology
Traditional broadcast receiver (such as digital TV or top box of digital machine) is only providing a content element or showing main screen and sub-screen simultaneously on the single physical display unit on the single physical display unit.
Even the traditional broadcast receiver can show main screen and sub-screen simultaneously on identical display screen, the prior art radio receiver also only can be arranged main screen and sub-screen with limited mode.In main screen under the situation of displaying contents, all elements of displaying contents (that is, video data, voice data and other data).On the other hand, in sub-screen under the situation of displaying contents, the part element of displaying contents only.
Content source comprises broadcast service (such as satellite broadcasting device, terrestrial broadcasting device or wired broadcasting device), storage medium (such as DVD or be connected to the external device (ED) of input).Yet, be difficult to use existing radio receiver on display screen, to show the content that so various content source provide.
In interactive TV application environment (such as multimedia home platform (MHP), senior common application (ACAP) and open cable application platform (OCAP)), suppose on physical display, only to export a screen.
In interactive TV application environment, for example adopt user interface (UI) based on home audio/video interoperability (HAVi).According to the HAViUI standard,, on physical display, also only show a screen usually even without the quantity that is presented at the screen on the physical display is applied restriction.
Summary of the invention
Technical problem
In this environment, the executable operations (such as decoding, Digital Signal Processing, user interaction process etc.) in the content of multimedia that shows on being difficult on independent screen to show in the content of multimedia screen.In addition, also being difficult to the screen is the dynamically life cycle of controlling application program and the use of resource of unit.
Therefore, need a kind of method that when on display screen, showing various contents in every way, is identified in the application of operating in the multiple screens environment.
Technical scheme
The invention provides a kind of application of on a plurality of screens, carrying out in the multiple screens environment that is identified in, in described multiple screens environment, on the physics display screen, show a plurality of content items.
To above and other objects of the present invention be described by the description of following preferred embodiment.
According to an aspect of the present invention, a kind of equipment that is used in multiple screens environment identification application is provided, described equipment comprises: digital signal processing module, and receiver, video information, audio-frequency information or data message, and based on video information, audio-frequency information or data message recovery service; Service processing module produces a plurality of logical screens of the service be used to show recovery; And output module, a plurality of logical screens that service processing module is provided are mapped to the diverse location on the display screen, wherein, and by carrying out the service context used and discerning the application that occurs in the service by identifying information.
According to a further aspect in the invention, a kind of equipment that is used in multiple screens environment identification application is provided, described equipment comprises: service processing module, generation are used to show the logical screen of service and are used to allow logical screen the display screen of and display logic screen relevant with service; And output module, the logical screen that produces is mapped to the specific region on the display screen of generation, wherein, discern application in the service by carrying out the service context used and identifying information.
According to a further aspect in the invention, provide a kind of method that is used in multiple screens environment identification application, described method comprises: receiver, video information, audio-frequency information or data message, and recover service; Generation is used to show a plurality of logical screens of the service of recovery; And described logical screen is mapped to diverse location on the display screen, wherein, discern application in the service by carrying out the service context used and identifying information.
According to a further aspect in the invention, provide a kind of method that is used in multiple screens environment identification application, described method comprises: generation is used to show the logical screen of service and the display screen that is used to show a plurality of logical screens; Described logical screen is mapped to arbitrary region on the display screen, wherein, discerns application in the service by carrying out the service context used and identifying information.
Description of drawings
By the detailed description of the preferred embodiments of the present invention being carried out below in conjunction with accompanying drawing, above-mentioned and other characteristics of the present invention and advantage will become more apparent, wherein:
Fig. 1 is the diagrammatic sketch that illustrates according to the configuration of the PiP screen of exemplary embodiment of the present invention;
Fig. 2 illustrates according to the logical screen of exemplary embodiment of the present invention and the diagrammatic sketch of the relation between the display screen;
Fig. 3 to Fig. 7 is the diagrammatic sketch that illustrates according to the configuration of the screen that comprises mapper of exemplary embodiment of the present invention;
Fig. 8 is the block diagram that illustrates according to the service source of exemplary embodiment of the present invention;
Fig. 9 and Figure 10 illustrate according to the non-abstract service of exemplary embodiment of the present invention and the diagrammatic sketch of abstract service;
Figure 11 illustrates the attribute information of logical screen and display screen and the diagrammatic sketch of interface;
Figure 12 is the diagrammatic sketch that illustrates according to the attribute " z-order " of the logical screen of exemplary embodiment of the present invention;
Figure 13 and Figure 14 are that each all illustrates the diagrammatic sketch according to the attribute " Display_Area " of the logical screen of exemplary embodiment of the present invention;
Figure 15 is the diagrammatic sketch that illustrates according to the method for display screen that two map of services are arrived of exemplary embodiment of the present invention;
Figure 16 is the block diagram of configuration of equipment that is used to provide a plurality of screens that illustrates according to exemplary embodiment of the present invention;
Figure 17 is the flow chart that illustrates according to the method for a plurality of screens of dynamic-configuration of exemplary embodiment of the present invention;
Figure 18 is the diagrammatic sketch of software architecture that is used to provide a plurality of screens that illustrates according to exemplary embodiment of the present invention;
Figure 19 is the diagrammatic sketch that illustrates according to the relation between the module of the composition application programming interfaces (API) of exemplary embodiment of the present invention layer;
Figure 20 illustrates to pass through module shown in Figure 19 at the flow chart that is presented at a plurality of service method that show on each respective logic screen on the display screen according to exemplary embodiment of the present invention;
Figure 21 is illustrated in to exchange the flow chart that is presented at the service method on the logical screen between the described module of Figure 19;
Figure 22 illustrates the operation of the application on a plurality of screens;
Figure 23 illustrates the data structure that is used to discern application according to exemplary embodiment of the present invention; And
Figure 24 illustrates the method for using according to the identification of exemplary embodiment of the present invention.
The reference title of the primary clustering the shown in＜accompanying drawing 〉
900: the equipment that is used to provide a plurality of screens
910: the broadcast singal receiver module
920: storage medium
930: outside input module
940: digital signal processing module
950: service processing module
960: output module
965: user/AIM
970: physical display
980: storage medium
990: outside output module
Embodiment
By with reference to following detailed description of the preferred embodiment and accompanying drawing, advantage of the present invention and characteristics and realize that the method for described advantage and characteristics can easily be understood.Yet the present invention can not be implemented with various forms, and should not be interpreted as limiting embodiment set forth herein.Yet.Thereby provide these embodiment disclosure will be thoroughly and complete and fully design of the present invention is conveyed to those skilled in the art, the present invention will only be limited by claim.In whole specification, identical label is meant identical parts.
Below, with reference to describing the present invention according to the user interface of exemplary embodiment of the present invention, the flow chart of method and computer program product.Should be appreciated that each piece of flow chart and the combination of the piece in flow chart can be realized by computer program instructions.These computer program instructions can be provided for the processor of all-purpose computer, special-purpose computer or other programmable data processing device with generation equipment, thereby, create the device that is used for being implemented in the function that a flow chart block or a plurality of flow chart block describe via the instruction that the processor of computer or other programmable data processing device is carried out.
These computer program instructions also can be stored in can instruct computer or other programmable data processing device with the computer of ad hoc fashion operation can with or computer-readable memory in, thereby be stored in computer can with or computer-readable memory in instruction generate the product that comprises execution command device of the function of appointment in a flow chart block or a plurality of flow chart block.
Computer program instructions also can be written into computer or other programmable data processing device, so that the sequence of operations step is performed the processing of carrying out with the generation computer on computer or other programmable devices, thereby the instruction of carrying out on computer or other programmable devices is provided for being implemented in the step of the function of describing in a flow chart block or a plurality of flow chart block.
Can represent module, code segment or partial code for every of flow chart, it comprises one or more executable instructions that are used to realize specific logic function.It should be noted that in the realization of some replacements, the function that marks can not carried out in order in these pieces.For example, two pieces that illustrate continuously in fact can substantially side by side be performed, and perhaps piece is carried out with opposite order sometimes, and this depends on the function that relates to.
In order to understand the present invention better, now be defined in the term that uses in the disclosure.
One group of content of multimedia that term " service " indication shows together, i.e. one group of service component.
Service component is the element of service, comprises video component, audio component and data component.Data component is the application program in the service.
The various resources, device and the execution state information that provide service required are provided the object of the execution of term " service context " indication control service.
The physical space of the content of term " physical display " indication actual displayed service.
The screen of term " display screen " indication actual displayed on physical display.Any service can directly be set, and display screen can be displayed on the physical display on display screen.Perhaps, at least one logical screen that is mapped to the specific region of display screen can be displayed on the physical display.
Term " logical screen " indicated number is the space of service arbitrarily.Logical screen was virtual screen before being mapped to display screen, therefore was not displayed on the physical display.
Logical screen and display screen can be the combinations of stationary background image, video raster and figure grating.The figure grating can be the combination of text, line, color and image or mixing of frame of video.
Term " main service " is indicated by the menu that shows on the physical display or the remote controller of user's control, perhaps by the selected service as master's service of the API that uses, and shows that the screen of main service is called as " main screen ".
By the menu that shows on the physical display or the selected service as the sub-services in the main service of remote controller of user's control, the PiP service can be displayed on picture-in-picture screen (PiP screen) or the main screen via the API that uses for term " picture in picture service (PiP service) " indication.
The PiP screen comprises that the screen of the part that occupies another screen that (a) to (d) among Fig. 1 illustrates and (e) among Fig. 1 illustrate to (f) show simultaneously with another screen and not with the screen of other screen overlay.In this case, be appreciated that the PiP screen can be included in the optional position in the physical display or go up in the zone and the screen of another screen overlay, as (g) among figure Fig. 1 with (h).Fig. 2 illustrates according to the logical screen of exemplary embodiment of the present invention and the diagrammatic sketch of the relation between the display screen.
With reference to Fig. 2, can use logical screen 210,212 and 214 to show service.Logical screen 210,212 and 214 is mapped to display screen 220,222 and 224 by mapping block 230.
At length, logical screen 210 and 212 is mapped to display screen 220, and logical screen 212 and 214 is mapped to display screen 222, and logical screen 210,212 and 214 is mapped to display screen 224.
In brief, show that at least one logical screen of service is mapped to the arbitrary region of display screen.
With reference to Fig. 3, will comprise that by mapper the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain with common size.The PiP screen that will only comprise video component by mapper is mapped to the entire display screen curtain with the size that reduces.In this case, on main screen, described main screen comes definite according to Z value with the PiP screen display of mapping.Reference symbol Z is meant after a while with the z-order value of describing.Overlapping screen can make up with display screen.Overlapping screen is to be arranged in outermost specific screens, and can use overlapping screen when the title function is provided.The PiP screen can only have video component (as shown in Figure 3), perhaps can have the combination (as shown in Figure 4) of stationary background image B, video raster V and figure grating G.
With reference to Fig. 5, will comprise that by mapper the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain with common size.To only comprise that by mapper two PiP screens (PiP screen # 1 and PiP screen #2) of video component are mapped to the arbitrary region of display screen with the size that reduces.In this case, the PiP screen of mapping is disposed on the main screen, and the Z value can be invariable.In addition, overlapping screen can make up with display screen.The configuration of screen can have a plurality of PiP screens (as shown in Figure 5) that only comprise video component, perhaps can have a plurality of PiP screens of the combination that comprises stationary background image B, video raster V and figure grating G.
Fig. 7 illustrates the POP screen.Be appreciated that the PiP screen is displayed on the inside of main screen, the POP screen display is in the outside of main screen.With reference to Fig. 7, will comprise that by mapper a plurality of PiP screens (PiP screen # 1 and PiP screen #2) of the combination of stationary background image B, video raster V and figure grating G are mapped to the arbitrary region of display screen with the size that reduces.In this case, the Z value of the POP screen # 1 of mapping and POP screen # 2 can be invariable.In addition, overlapping screen can make up with display screen.
Realize mapping block 230 by interface or function that the various computer programming languages that will be performed are prepared, mapping block 230 is by using above-mentioned information and create as parameter or changing relation between logical screen and the display screen.
In addition, as shown in Figure 8, can on display screen, show the service that various services source provides, and can on physical display, show described display screen.
There is service source (such as terrestrial broadcasting device 320 and wired broadcasting device 330) that broadcast service is provided, service source that is stored in the service in the storage medium (such as personal video recorder (PVR) 340) and the service source (not having shown in Figure 8) that service is provided via cable network or wireless network are provided.
Then, use preordering method or by the user or use the method that is provided with any service directly is set on the display screen that will be presented on the physical display.Otherwise, on physical display 350, show at least one logical screen that is mapped to the arbitrary region on the display screen.In brief, on physical display 350, show the service that terrestrial broadcasting device 320, cable broadcast device 330 and PVR provide.
Fig. 8 illustrates terrestrial broadcasting device 320, wired broadcasting device 330 and PVR340 as the service source, but the invention is not restricted to this.According to exemplary embodiment of the present invention, the content of multimedia source that any kind of the content of multimedia that can show together is provided can be the service source.
As Fig. 9 and shown in Figure 10, can be classified as abstract service and non-abstract service according to the service of exemplary embodiment of the present invention.
Abstract service is not the service that the broadcast singal of transmission in real time provides, but is independent of the service of broadcast channel.Abstract service only comprises data component (being application program) and does not comprise video component and audio component.The example of abstract service comprises the service that not binding is used that has based on open cable application platform (OCAP) standard.
Non-abstract service is understood that the service except abstract service.
According to current exemplary embodiment of the present invention, abstract service and non-abstract service have independence.For example, can abstract service directly be set on physical display, and can on logical screen, show non-abstract service by logical screen.Then, logical screen can be mapped to the display screen that is provided with abstract service.Can pass through physical display output display screen curtain thereafter.Like this, can be independent of non-abstract service and on display screen, show abstract service.In addition, abstract service can be mapped to different logical screens with non-abstract service.Logical screen can be mapped to single display screen thereafter.In other words, can be independent of non-abstract service and on display screen, show abstract service.
According to current exemplary embodiment of the present invention, logical screen can be classified as different objects with display screen.Perhaps, screen can be used as logical screen or display screen according to the attribute information of a screen object.
At length, if having predetermined value with the corresponding screen object attribute of the characteristic of logical screen, other screen object attribute has fixed value, and then screen object can be used as logical screen.On the other hand, if having predetermined value with the corresponding screen object attribute of the characteristic of display screen, other screen object attribute has fixed value, and then screen object can be used as display screen.
The attribute information of screen object comprises a plurality of attributes: " z-Order ", " Display_Area ", " Visibility ", " Associated_Display_Screen ", " Associated_Service_Contexts ", " Associated_Logical_Screens " and " OutputPort ".
If attribute " z-Order ", " Display_Area ", " Visibility ", " Associated_Display_Screen " and " Associated_Service_Contexts " have predetermined value, attribute " Associated_Logical_Screens " and " OutputPort " have fixed value, and then screen object can be used as logical screen.
On the other hand, if attribute " Associated_Service_Contexts ", " Associated_Logical_Screens " and " OutputPort " have predetermined value, attribute z-Order ", " Display_Area ", " Visibility " and " Associated_Display_Screen " have fixed value, then screen object can be used as display screen.
Figure 11 illustrates the attribute information and the interface of logical screen and display screen.
With reference to Figure 11, attribute " Type " 510 is used for determining screen type-logical screen or display screen.
With reference to Figure 11, attribute " z-Order " 520 be used for determining a plurality of logical screens along the z axle with which kind of sequence arrangement.Figure 12 illustrates the difference configuration of the logical screen on the physical display of various combination of value of the attribute " z-Order " that is used for logical screen.
With reference to Figure 12, first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610 respectively.At length, first logical screen 620 is presented on the display screen 610, and second logical screen 630 and first logical screen 620 are presented on the display screen 610 with overlapping.In other words, the direction along the z axle is arranged in order display screen 610, first logical screen 620 and second logical screen 630.In this case, the attribute " z-Order " that the attribute of first logical screen 620 " z-Order " can the value of being set to 1, the second logical screen 630 can the value of being set to 2.The attribute " z-Order " of first logical screen 620 and second logical screen 630 can be set to any numeral or character, as long as they can represent the particular order that first logical screen 620 and second logical screen 630 are arranged along the z axle.
As Figure 13 and shown in Figure 14, attribute " Display_Area " the 530th is about the information in the display screen zone of logical screen.
Figure 13 illustrates the whole zone that logical screen 710 is mapped to display screen 720, and Figure 14 illustrates the subregion that logical screen 730 is mapped to display screen 740.
Attribute " Display_Area " can comprise the information of the two-dimensional coordinate of the predetermined portions of specifying the display screen that logical screen is mapped to, and can comprise that perhaps the information of specifying the precalculated position on the display screen and indication logical screen depart from what the deviant of precalculated position on the display screen.
Attribute " Visibility " 530 determines that logical screen shows still demonstration invisibly visibly on display screen.Can logical screen be occurred on display screen by the value that changes " Visibility " 530 or disappear from display screen.
Attribute " Associated_Display_Screen " the 540th is about the information of the display screen relevant with logical screen.The logical screen that all has nothing to do with any display screen can not be presented on the physical display or not be sent to outside output device.
Attribute " Associated_Service_Contexts " the 550th is about the information of the service context that is connected to logical screen or display screen.The service that is provided with in this service context can be displayed on logical screen or the display screen.
Attribute " Associated_Logical_Screens " the 560th is about the information of the logical screen relevant with display screen.
Attribute " OutputPort " the 570th, about the information with the device of output display screen curtain, this device comprises display screen, wire/wireless communication medium and various storage medium.
Can be provided for discerning or changing the interface of the value of the attribute shown in Fig. 6 A and Fig. 6 B.With reference to Fig. 6 A and Fig. 6 B, interface can comprise: be used to set property or with logical screen be connected to display screen interface " SET ", be used to add property value or with logical screen be connected to service interface " ADD ", be used for the interface " GET " of recognition property value and be used for the interface " REMOVE " of delete property value.These interfaces can comprise processing, function, program or the method for the function of carrying out them respectively.
For example, method " getDisplayScreen (void) " is returned the display screen relevant with current screen.At length, if current screen is a logical screen, then method " getDisplayScreen (void) " is returned relevant display screen.If current screen is a display screen, then method " getDisplayScreen (void) " is returned the reference information about current screen.In addition, if current screen is a logical screen, but there are not screen associated, then method " getDisplayScreen (void) " return value " NULL ".
According to another example, method " public void setDisplay Area (HScreenRectangle rect) throws SecurityException, IllegalStateException " is provided for current logical screen is mapped to the function of the presumptive area of relevant display screen.The example that is provided as parameter is the class " HScreenRectangle " of bag " org.havi.ui ", and has two-dimensional position information.The execution of method " SecurityException " and " IllegalStateException " is directed to the abnormal operation of method " setOutputScreen (HScreenscreen) ".When current screen is logical screen or in the part of the display screen relevant with current logical screen because the characteristic of host platform can not change the time, executing method " IllegalStateException ".
According to another example, method " getOutputArea (void) " is returned the area information of current screen as HScreenRectangle information.If current screen and display screen are corresponding, then method " getOutputArea (void) " is returned the HScreenRectangle information with value identical with HScreenRectangle (0,0,1,1).If current screen is a logical screen, then method " getOutputArea (void) " is returned the information in the zone on the display screen that occupies about current screen.If current screen is a logical screen, but not relevant with any display screen, method " getOutputArea (void) " return value " NULL " then.
The particular term of Shi Yonging is meant special interface in the following description.Yet, it should be appreciated by those skilled in the art that specific function is named and only be used to indicate it functional.This detailed description of exemplary embodiment is not to want distinguishing function nominally, but distinguishes on function.
Figure 15 is illustrated in the diagrammatic sketch that the processing of two services is set with being mapped on the display screen of single screen.
With reference to Figure 15, first service comprises all three service component (being video component, audio component and data component), and second service only comprises video component and audio component.Yet the present invention does not apply any restriction to service component, and the service of first shown in Fig. 8 and second service are exemplary.
As shown in figure 15, with prior art in much at one mode show that on physical display first service and second serves.According to current exemplary embodiment of the present invention, can on physical display, show a plurality of services independently of one another, and the quantity that can be presented at the service on the single display screen not carried out any restriction.
Figure 16 is the block diagram of equipment that is used to provide a plurality of screens according to exemplary embodiment of the present invention.
With reference to Figure 16, be used to provide the equipment 900 of a plurality of screens to comprise digital signal processing module 940, service processing module 950, output module 960 and Subscriber Interface Module SIM 965.
In addition, equipment 900 comprises broadcast singal receiver module 910, storage medium 920 and the outside input module 930 as the service source, and comprises physical display 970, storage medium 980 and outside output module 990 as the service output medium.
Use the meaning of term " module " to be at this, but be not limited to, realize the software and hardware assembly of particular task, such as field programmable gate array (FPGA) or application-specific integrated circuit (ASIC) (ASIC).Module can be configured to easily and reside on addressable storage medium, and can be configured on one or more processors and carry out.Therefore, for instance, module can comprise: such as assembly, process, function, attribute, process, subprogram, program code segments, driver, firmware, microcode, circuit, data, database, data structure, table, array and the variable of component software, OO component software, class component and task component.The function that provides in assembly and module can be combined into assembly and module still less, perhaps can further be separated into other assembly and module.
The various information that digital signal processing module 940 receives such as the service of content of multimedia from broadcast singal receiver module 910, storage medium 920 and outside input module 930, for example, video information, audio-frequency information or data message.
Broadcast singal receiver module 910 receiving satellite broadcast signals, ground broadcast signal or cable broadcasting signal also send the broadcast singal that receives, video information, audio-frequency information or the data message of storage medium 920 stores service, outside input module 930 receive video information, audio-frequency information or the data message of service from external device (ED) (such as being connected to the network of network interface arrangement).
Digital signal processing module 940 uses the service component that receives to recover a plurality of services.The service that recovers comprises abstract service or non-abstract service.
Here, " a plurality of service " is meant two or more services that broadcast singal receiver module 910 sends, perhaps two or more services of sending respectively of broadcast singal receiver module 910 and storage medium 920.
Digital signal processing module 940 can the selection according to user or application recover service under the help of user/AIM 965.In this case, user or application can be selected the connection between service arbitrarily and the screen.
Can come the service of processing digital signal processing module 940 recoveries by service module 950.Yet, the service that digital signal processing module 940 recovers can be mapped directly to the specific part of the display screen that output module 960 produces.
The display screen that output module 960 provides can be presented on the physical display 970, perhaps is stored in the storage medium 980.The example of storage medium 980 comprises computer-readable floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, BD (Blu-ray disc) and semiconductor memory.
In addition, the display screen that output module 960 provides can be sent to the external device (ED) that is connected to network via outside output module 990.
For this reason, output module 960 can comprise a plurality of output ports, can provide display screen via described output port.In this case, can provide display screen via the output port or the output port under the help of user/AIM 965, selected of user that set in advance to acquiescence.
The service that user or application can use Subscriber Interface Module SIM 965 to select in a plurality of services or recover to expect.In addition, the user can use Subscriber Interface Module SIM 965 to select in a plurality of display screens one.
Because the module shown in Figure 16 is divided according to their function, therefore can be connected to other module.
Figure 17 is the flow chart that illustrates according to the method for a plurality of screens of dynamic-configuration of exemplary embodiment of the present invention.
Usually, video information, audio-frequency information and the data message of composition content of multimedia are sent out with predetermined format (for example, mpeg stream form).At operation S1010, be used to provide equipment receiver, video information, audio-frequency information and the data message of service (such as the content of multimedia service), and recover service based on video information, audio-frequency information and data message.Here, can or pre-determine the service that recovers at operation S1010 by user or application choice.The user can use at the menu that shows on the display unit or remote controller and select connection between any screen and the screen.Application can use API to select to connect.
In addition, data message comprises the application message about the application that is used to serve, and this application message comprises the signal message whether the indication application program can be carried out on the PiP screen.The example of application message comprises based on the application information table of MHP standard (AIT) with based on the expanded application information table (XAIT) of OCAP standard.Can add signal message to application message.
Below, at operation S1020, thereby the service that recovery is set can be presented at it on logical screen.At operation S1030, logical screen is mapped to display screen.At operation S1040, display screen is offered the user who uses display screen, storage medium or network.
The service of the recovery that on physical display, shows via logical screen shown in Figure 17.Yet, can directly on physical display, not show the service that recovers by logical screen.
When the user selects the PiP service, realize the PiP service with two kinds of patterns.In first kind of pattern, only there is the video component of serving to be provided, and is not the independent logical screen of PiP service-creation from the PiP of main screen selection, that is, and the PiP screen.Under second kind of pattern, create the independent logical screen that is used for the PiP service, with the PiP service of selecting on the PiP screen that is provided at establishment.
For simply, Figure 17 illustrates only with the method for a map of services to display screen.Yet, can by a plurality of logical screens or not by a plurality of logical screens with a plurality of map of services to display screen.
When by this way display screen being offered the user, the user can carry out a plurality of services.
Figure 18 is the diagrammatic sketch of software architecture that is used to provide a plurality of screens that illustrates according to exemplary embodiment of the present invention.
With reference to Figure 18, software architecture 1100 comprises device Drive Layer 1110, application programming interfaces (API) layer 1120 and application layer 1130.
The user makes device Drive Layer 1110 provide display screen via physical display under the help of application layer 1130, perhaps display screen is stored in the storage medium.In addition, the user can make device Drive Layer 1110 via network display screen be sent to external device (ED).
For this reason, device Drive Layer 1110 can comprise a plurality of output ports that display screen can be provided.Otherwise api layer 1120 can comprise a plurality of output ports.
For a plurality of logical screens of dynamic-configuration on display screen, api layer 1120 can comprise a plurality of software modules, for example, multi-screen manager module " MultiScreenManager " 1210, multi-screen context module " MultiScreenContext " 1230, multi-screen context detectaphone module " MultiScreenContextListener " 1250 and multi-screen context events module " MultiScreenContextEvent " 1240, as shown in figure 19.
When changing the attribute information of screen object 1220 by multi-screen context module 1230, multi-screen context events module 1240 is as the reformed event class of attribute information of announcing screen object 1220, and multi-screen context detectaphone module 1250 is used as can be with the detectaphone interface object of predetermined application class realization, and described predetermined application class attempts receiving the incident of multi-screen context events module 1240 propositions.
Using 1260 is the modules that drive on application layer 1130.Use 1260 and allow the user to select the service of expecting, and on display screen, freely arrange a plurality of logical screens.
At length, use 1260 and will allow the various command of user's dynamic-configuration and management logic screen to send to multi-screen manager module 1210, and multi-screen manager module 1210 is controlled and will be operated accordingly by the various command that multi-screen context module 1230 is performed.
Multi-screen manager module 1210 (not shown) receive the service component that various services source provides from device Drive Layer 1110, and executable operations is to show the service component that receives on logical screen or display screen.
Figure 20 is the flow chart that module shown in Figure 19 is presented at a plurality of service method that show on each respective logic screen on the display screen that passes through that illustrates according to exemplary embodiment of the present invention.
With reference to Figure 20, at operation S1310, multi-screen manager module 1210 produce display screens and with the corresponding a plurality of logical screens of the quantity of the service that will be performed.
At operation S1320, multi-screen manager module 1210 is connected to logical screen each the corresponding service that receives from device Drive Layer 1110.Multi-screen manager module 1210 can be set to be used for the parameter of logical screen service by the service context object of the service that receives and call the method " addServiceContext " that is used for each logical screen.Method " addServiceContext " is connected to service with logical screen, and can provide described method by multi-screen context module 1230.
At operation S1330, in case logical screen is connected to each service, multi-screen manager module 1210 just is connected to display screen with logical screen.At this moment, multi-screen manager module 1210 can be set to parameter and call the method for the logical screen that is used for each screen " setDisplayScreen " by the display screen object that logical screen is connected to.Method " setDisplayScreen " is connected to display screen with logical screen, and can provide described method by multi-screen context module 1230.
Method " setDisplayScreensetDisplayScreen " can be set to " public voidsetDisplayScreensetDisplayScreen (HScreen screen) throws SecurityException; Illegal StateException ", and the example " HScreen " that this method permission provides as parameter is relevant with current logical screen.In this case, example HScreen display screen preferably.
The parameter of method " setDisplayScreen (HScreen screen) " can comprise value " NULL ".In this case, when not having abnormality processing when manner of execution " setDisplayScreen (HScreen screen) ", current logical screen is no longer relevant with display screen.
The execution of method " SecurityException " and " IllegalStateException " can be directed the abnormal operation as method " setOutputScreen (HScreen screen) ".
When current screen is logical screen, perhaps in the part of the display screen relevant with current logical screen because the characteristic of host platform and can not change the time, executing method " IllegalStateException ".
At operation S1340, determine the zone on the display screen that logical screen will be mapped to respectively.Simultaneously, can call the preordering method that multi-screen context module 1230 provides, to determine that logical screen is with the zone on the display screen that is shown.
Figure 21 illustrates the flow chart that is presented at the service method on the logical screen according to the exchange between module shown in Figure 19 of exemplary embodiment of the present invention.
At operation S1410, the service that exchanges between two logical screens of multi-screen manager module 1210 interim terminations.
Below, at operation S1420, exchange is about the information of service between two logical screens.At this moment, to each call method " removeServiceContext " in two logical screens and method " addServiceContext ", thereby exchanging the service context that in two logical screens, is provided with between two logical screens.Method " removeContext " is removed the service context that is connected to logical screen, and method " addServiceContext " is added new service context to logical screen.Can provide method " removeServiceContext " and method " addServiceContext " by multi-screen context module 1230.According to current exemplary embodiment of the present invention, between logical services, exchange information on services, thereby obtain the effect of exchange main screen and sub-screen about the service that is connected with logical services.In addition, according to current embodiment of the present invention,, also can between the logical screen of any amount, exchange described service even on display screen, carry out three or more services.
At operation S1430, the generation that produces certain incident, described incident be service with two logical screens between be connected and change.Below, at operation S1440, multi-screen context events module sends to multi-screen context detectaphone module 1250 with incident, and begins to carry out the up-to-date service that is connected to two logical screens.
Can carry out identical application by a plurality of service context that belong to different screen, described hereinafter with reference to Fig. 2.For example, with reference to Figure 22, can on main screen HScreen1 and PiP screen HScreen2, carry out identical application.
Can compare with application identification information App_ID by the application supplier identification information Org_ID that will use and determine that a plurality of application of carrying out respectively are identical application or different application on a plurality of screens.With reference to Figure 22, identical application supplier identification information Org_ID and identical application identification information App_ID shared in the application of carrying out respectively on main screen HScreen 1 and PiP screen HScreen 2, thereby is difficult to determine exactly that the current application of carrying out is to carry out on the main screen HScreen 1 or execution on PiP screen HScreen 2.
That is to say that share identical Org_ID and App_ID even use, except Org_ID and App_ID, additional information also is necessary, to determine that exactly a plurality of application of carrying out respectively are identical application or different application on a plurality of screens.The data structure of additional information shown in Figure 23.
With reference to Figure 23, class " OcapAppID " derived class " AppID ".Class " AppID " comprises integer variable " AID " and " OID " and function " getAID () " and " getOID () ", returns the value of variable " AID " and " OID ".
The function " getServiceContext () " that the class " OcapAppID " of having inherited class " AppID " comprises the variable " sc " that is used to discern service context and returns the value of variable " sc ".Variable " sc " can be interpreted as pointer information or reference information, and indication is used to carry out the service context of application.
Because class " OcapAppID " not only comprises " Org ID " and " App ID ", but also comprise the identifying information of the service context that is used to carry out application, therefore, even when on a plurality of screens, carry out using, also can discern each of a plurality of examples of application.Be described in further detail with reference to Figure 24 below.
With reference to Figure 24, to suppose to use A and have Org_ID value " Oxaaaaaaaa " and App_ID value " 0x4000 ", class " OcapApp_ID_1 " has identical Org_ID and App ID value with class " OcapApp_ID_2 ".
Yet, because the variable SC_1 of class " OcapApp_ID_1 " comprises the identifying information of service context " ServiceContext_1 ", the variable SC_2 of class " OcapApp_ID_2 " comprises the identifying information of service context " Service Context_2 ", therefore, even when on a plurality of screens, carry out using, also can discern each of a plurality of examples of application.
Utilizability on the industry
According to the present invention, can use the single physical display screen to carry out a plurality of services that each provenance (such as wired broadcasting, terrestrial broadcasting, various storage medium and outside input) provides in every way.
In addition, according to the present invention, even when on a plurality of screens, carry out using, also can be in multiple screens environment in a plurality of examples of recognition application each.
Although specifically illustrated and described the present invention with reference to exemplary embodiment of the present invention, but it should be appreciated by those skilled in the art that, under the situation of the spirit and scope of the present invention that do not break away from the claim qualification, can carry out the change of various forms and details to it.Therefore, being appreciated that provides above-mentioned exemplary embodiment only to be used for describing, with any restriction that is not interpreted as scope of the present invention.
Claims (12)
1, a kind of equipment that is used in multiple screens environment identification application, described equipment comprises:
Digital signal processing module, receiver, video information, audio-frequency information or data message, and based on video information, audio-frequency information or data message recovery service;
Service processing module produces a plurality of logical screens of the service be used to show recovery; And
Output module, a plurality of logical screens that service processing module is provided are mapped to the diverse location on the display screen,
Wherein, discern the application that occurs in the service by the service context of execution application and by identifying information.
2, the method for claim 1, wherein identifying information comprises information about the application supplier that application is provided.
3, the method for claim 1, wherein identifying information comprises information about using.
4, a kind of equipment that is used in multiple screens environment identification application, described equipment comprises:
Service processing module, generation are used to show the logical screen of service and are used to allow logical screen the display screen of and display logic screen relevant with service; And
Output module is mapped to the logical screen that produces the specific region on the display screen of generation,
Wherein, discern application in the service by service context that carry out to use and identifying information.
5, equipment as claimed in claim 4, wherein, identifying information comprises the information about the application supplier that application is provided.
6, equipment as claimed in claim 4, wherein, identifying information comprises the information about using.
7, a kind of method that is used in multiple screens environment identification application, described method comprises:
Receiver, video information, audio-frequency information or data message, and recover service;
Generation is used to show a plurality of logical screens of the service of recovery; And
Described logical screen is mapped to diverse location on the display screen,
Wherein, discern application in the service by service context that carry out to use and identifying information.
8, method as claimed in claim 7, wherein, identifying information comprises the information about the application supplier that application is provided.
9, method as claimed in claim 7, wherein, identifying information comprises the information about using.
10, a kind of method that is used in multiple screens environment identification application, described method comprises:
Generation is used to show a plurality of logical screens of service and the display screen that is used to show described a plurality of logical screens;
Described logical screen is mapped to arbitrary region on the display screen,
Wherein, discern application in the service by service context that carry out to use and identifying information.
11, method as claimed in claim 10, wherein, identifying information comprises the information about the application supplier that application is provided.
12, method as claimed in claim 10, wherein, identifying information comprises the information about using.
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US78957706P | 2006-04-06 | 2006-04-06 | |
| US60/789,577 | 2006-04-06 | ||
| US60/812,090 | 2006-06-09 | ||
| US60/870,471 | 2006-12-18 | ||
| US60/918,894 | 2007-03-20 | ||
| KR1020070033464 | 2007-04-04 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101416494A true CN101416494A (en) | 2009-04-22 |
Family
ID=40595676
Family Applications (11)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Family Applications Before (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Family Applications After (6)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Country Status (1)
| Country | Link |
|---|---|
| CN (11) | CN101416490A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105165019A (en) * | 2013-04-19 | 2015-12-16 | 三星电子株式会社 | Method and apparatus for transmitting and receiving additional information in a broadcast communication system |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101763842B (en) * | 2009-11-13 | 2012-07-11 | 广东威创视讯科技股份有限公司 | Spliced wall body allocation system and position mapping method for establishing display units |
| KR101743776B1 (en) | 2010-09-28 | 2017-06-05 | 엘지전자 주식회사 | Display apparatus, method thereof and method for transmitting multimedia |
| CN103176684B (en) | 2011-12-22 | 2016-09-07 | 中兴通讯股份有限公司 | A kind of method and device of multizone interface switching |
| US9632648B2 (en) | 2012-07-06 | 2017-04-25 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
| CN103631551A (en) * | 2012-08-27 | 2014-03-12 | 深圳市蓝韵网络有限公司 | Local display method for remote desktop in medical consultation system |
| US20180012570A1 (en) * | 2016-07-07 | 2018-01-11 | Futurewei Technologies, Inc. | Apparatus and method for mapping frame buffers to logical displays |
| CN111045622B (en) * | 2019-11-21 | 2023-06-30 | 中国航空工业集团公司西安航空计算技术研究所 | Object-oriented display control interface model |
-
2007
- 2007-04-04 CN CNA2007800120942A patent/CN101416490A/en active Pending
- 2007-04-05 CN CNA2007800121837A patent/CN101416492A/en active Pending
- 2007-04-05 CN CNA2007800121926A patent/CN101416493A/en active Pending
- 2007-04-05 CN CNA2007800120317A patent/CN101416489A/en active Pending
- 2007-04-05 CN CNA2007800122149A patent/CN101416494A/en active Pending
- 2007-04-05 CN CNA2007800121146A patent/CN101416491A/en active Pending
- 2007-04-05 CN CNA2007800124017A patent/CN101416496A/en active Pending
- 2007-04-05 CN CNA2007800123118A patent/CN101416495A/en active Pending
- 2007-04-05 CN CNA2007800120213A patent/CN101416488A/en active Pending
- 2007-04-05 CN CNA2007800124144A patent/CN101416497A/en active Pending
- 2007-04-05 CN CNA2007800120143A patent/CN101416487A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105165019A (en) * | 2013-04-19 | 2015-12-16 | 三星电子株式会社 | Method and apparatus for transmitting and receiving additional information in a broadcast communication system |
| CN105165019B (en) * | 2013-04-19 | 2019-09-17 | 三星电子株式会社 | Method and apparatus for sending and receiving additional information in broadcast communication system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101416491A (en) | 2009-04-22 |
| CN101416496A (en) | 2009-04-22 |
| CN101416495A (en) | 2009-04-22 |
| CN101416489A (en) | 2009-04-22 |
| CN101416493A (en) | 2009-04-22 |
| CN101416487A (en) | 2009-04-22 |
| CN101416497A (en) | 2009-04-22 |
| CN101416488A (en) | 2009-04-22 |
| CN101416492A (en) | 2009-04-22 |
| CN101416490A (en) | 2009-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101238721B (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| KR20080030977A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| CN101416494A (en) | Apparatus and method for identifying an application in the multiple screens environment | |
| KR100917885B1 (en) | Method and apparatus for providing a plurality of screens, and a computer readable recording medium having embodied thereon a computer program for executing the method for providing a plurality of screens | |
| MX2008012869A (en) | Apparatus and method for identifying an application in the multiple screens environment. | |
| KR100791302B1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR20070100110A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR20070017011A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR20070017004A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |