CN101416497A - Apparatus for providing multiple screens and method of dynamically configuring multiple screens - Google Patents
Apparatus for providing multiple screens and method of dynamically configuring multiple screens Download PDFInfo
- Publication number
- CN101416497A CN101416497A CNA2007800124144A CN200780012414A CN101416497A CN 101416497 A CN101416497 A CN 101416497A CN A2007800124144 A CNA2007800124144 A CN A2007800124144A CN 200780012414 A CN200780012414 A CN 200780012414A CN 101416497 A CN101416497 A CN 101416497A
- Authority
- CN
- China
- Prior art keywords
- screen
- logical
- service
- logical screen
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
An apparatus for providing multiple screens and a method of dynamically configuring multiple screens are provided. The apparatus includes a digital signal processing module which receives at least one of video information, audio information, and data information and rectories a plurality of services based on the at least one of the video information, the audio information and the data information; a service processing module which generates a display screen and a plurality of logical screens for displaying the restored services; ; and an output module which maps the plurality of logical screens provided by the service processing module to different locations on the display screen, wherein each of the plurality of logical screens includes at least one of a background still image, a video raster, and a graphic raster, and each of the plurality of logical screens has attribute information indicating an order of arranging the at least one of the background still image, the video raster, and the graphic raster included in the logical screen.
Description
Technical field
Equipment according to the invention and method relate to configuring multiple screens, more specifically, relate to and dynamically are configured in the multi-screen that plurality of kinds of contents is provided on the single physical display unit.
Background technology
The radio receiver of prior art (such as Digital Television (TV) or top box of digital machine) only provides a kind of content element on the single physical display unit, or shows main screen and sub-screen on the single physical display unit simultaneously.
Although the radio receiver of prior art can show main screen and sub-screen simultaneously on same display screen, they can only arrange main screen and sub-screen in the mode of limited quantity.Under the situation of displaying contents, all elements of content (that is, video data, voice data and other data) is shown in main screen.On the other hand, in sub-screen under the situation of displaying contents, some elements of displaying contents only.
Content source comprises broadcast service (such as satellite broadcasting radio station, terrestrial broadcast radio station or wired broadcasting station), storage medium (such as digital universal disc (DVD)) or is connected to the external device (ED) of input terminal.Yet, use existing radio receiver, be difficult to the content that shows that these various content source provide.
(, suppose on physical display, only to export a screen at interactive TV application environment such as family multi-media platform (MHP), senior common application platform (ACAP) and open cable application platform (OCAP).
For example, in interactive TV application environment, adopt user interface (UI) based on home audio/video interaction technique (HAVi).According to HAVi UI standard,, on physical display, only show a screen usually although the quantity that is presented at the screen on the physical display is not applied restriction.
Summary of the invention
Technical problem
In this environment, be difficult on independent screen, show in the content of multimedia, to operations such as a kind of execution such as the decoding in the content of multimedia that on screen, shows, Digital Signal Processing, user interaction process.In addition, also being difficult to the screen is the dynamically life cycle of controlling application program and the use of resource of unit.
Therefore, there are the needs that on the screen of dynamic-configuration, show the method for various contents to a kind of.
Technical scheme
The invention provides a kind of dynamic-configuration that the multi-screen of plurality of kinds of contents is provided on physical display.
According to an aspect of the present invention, provide a kind of equipment that multi-screen is provided.Described equipment comprises: digital signal processing module, and at least one in receiver, video information, audio-frequency information and the data message also recovered a plurality of services based in video information, audio-frequency information and the data message at least one; Service processing module produces display screen and is used to show a plurality of logical screens of the service of recovery; And output module, a plurality of logical screens that service processing module is provided are mapped to the diverse location on the display screen, wherein, each logical screen has the attribute information that the order that is included in stationary background image, video raster and figure grating in the logical screen is arranged in indication.
A kind of method of dynamic-configuration multi-screen is provided according to a further aspect in the invention.Described method comprises: at least one in receiver, video information, audio-frequency information and the data message; Recover a plurality of services based in video information, audio-frequency information and the data message at least one; Produce display screen and be used to show a plurality of logical screens of the service of recovery; And a plurality of logical screens are mapped to diverse location on the display screen, wherein, each logical screen has the attribute information that the order that is included in stationary background image, video raster and figure grating in the logical screen is arranged in indication.
Description of drawings
By the detailed description of reference accompanying drawing to exemplary embodiment of the present, above-mentioned and other aspects of the present invention will become apparent, wherein:
Figure 1A to Fig. 1 H illustrates the diagrammatic sketch of the configuration of PiP screen according to an exemplary embodiment of the present invention;
Fig. 2 illustrates the diagrammatic sketch of the relation between the logical screen and display screen according to an exemplary embodiment of the present invention;
Fig. 3 illustrates the diagrammatic sketch of serving the source according to an exemplary embodiment of the present invention;
Fig. 4 A and Fig. 4 B illustrate the diagrammatic sketch of abstract service and non-abstract service according to an exemplary embodiment of the present invention;
Fig. 5 illustrates the attribute information of logical screen and display screen and the diagrammatic sketch of interface;
Fig. 6 A and Fig. 6 B illustrate the diagrammatic sketch of the attribute of logical screen " z-order " according to an exemplary embodiment of the present invention;
Fig. 7 A and Fig. 7 B illustrate the diagrammatic sketch of the attribute of logical screen " Display_Area " according to an exemplary embodiment of the present invention;
Fig. 8 illustrates according to an exemplary embodiment of the present invention with the diagrammatic sketch of two map of services to the method for display screen;
Fig. 9 is the block diagram that the configuration of the equipment that is used to provide multi-screen according to an exemplary embodiment of the present invention is shown;
Figure 10 illustrates the flow chart of the method for dynamic-configuration multi-screen according to an exemplary embodiment of the present invention;
Figure 11 is the diagrammatic sketch that the software architecture that multi-screen is provided according to an exemplary embodiment of the present invention is shown;
Figure 12 is the diagrammatic sketch that the relation between the module of forming application programming interfaces (API) layer according to an exemplary embodiment of the present invention is shown;
Figure 13 illustrates according to an exemplary embodiment of the present invention the module shown in Figure 12 at the flow chart that is presented at a plurality of service method that show on each respective logic screen on the display screen; And
Figure 14 illustrates to exchange the flow chart that is presented at the service method on the logical screen between the module shown in Figure 12 according to an exemplary embodiment of the present invention.
Embodiment
With reference to the detailed description and the accompanying drawings of following exemplary embodiment, complete understanding advantage of the present invention and characteristics and realize method of the present invention more.Yet the present invention can realize according to a lot of different forms, and should not be understood that to be confined to exemplary embodiment described here.On the contrary, thereby provide these exemplary embodiment the disclosure with thorough and comprehensive, and design of the present invention is conveyed to those skilled in the art fully, the present invention only is defined by the claims.Run through specification, identical label is represented identical parts.
Following reference is according to the user interface of exemplary embodiment of the present invention, method and and flow chart description the present invention of computer program.To understand, can come each square frame among the flow for displaying figure and the combination of the square frame in the flow chart by computer program instructions.These computer program instructions are offered all-purpose computer, special-purpose computer or other programmable data processing device producing machine, thereby create the device of the function that is used for being implemented in the flowchart block appointment via the instruction that the processor of computer or other programmable data processing device is carried out.
These computer program instructions also can be stored in can vectoring computer or other programmable data processing device work in concrete mode, thereby be stored in computer can with or the instruction of computer-readable memory produce and comprise the product that is implemented in the command device of the function of appointment in the flowchart block.
Computer program instructions also can be loaded into computer or other programmable data processing device, so that the sequence of operations step that will carry out on computer or other programmable data processing device produces computer implemented processing, thereby the instruction of carrying out on computer or other programmable data processing device is provided for being implemented in the step of the function of appointment in the flowchart block.
Each square frame in the flow chart can represent to comprise module, code segment or the partial code of the one or more executable instructions that are used to realize specific logical function.It should be noted that in some alternative realizations, the function that writes down can be not according to occurring in sequence in square frame.For example, in fact two square frames shown in the order can be performed substantially simultaneously, or some the time be performed with reverse order, this depends on relevant function.
In order to understand the present invention better, now be defined in the term that uses in the disclosure.
One group of content of multimedia that term " service " indication shows together, that is, and one group of service component.
Service component is the element of service and comprises video component, audio component and data component.Data component is the application program in the service.
The object of the execution of term " service context " indication may command service, and various resources, device and the execution state information that provides service required is provided.
The physical space of the content of term " physical display " indication actual displayed service.
Term " display screen " indication actual displayed is at the screen of physical display.Service can directly be set in the display screen arbitrarily, and display screen can be displayed on the physical display.Perhaps, at least one logical screen that is mapped to the specific region of display screen can be displayed on the physical display.
The space that is shown is served in term " logical screen " indication arbitrarily.Logical screen is to be virtual screen before being mapped to display screen, and therefore is not displayed on the physical display.
Logical screen and display screen can be stationary background image, video raster and figure grating.The figure grating can be the combination of text, line, color and image or the mixing of frame of video.
Term " main service " indication user is by being presented at menu or the remote controller on the physical display or using the selected service as main service by API, and the screen that main service is shown is called " main screen ".
Term " picture in picture service (PiP service) " indication user is by the menu or the remote controller that show on physical display or use the selected service as the sub-services in the main service via API, and the PiP service can be displayed on picture-in-picture screen (PiP screen) or main screen.
The PiP screen comprises the screen and the screen that shows simultaneously with another screen shown in Fig. 1 E and Fig. 1 F of the part that occupies another screen shown in Figure 1A to Fig. 1 D under the situation that does not cover other screens.In this case, shown in Fig. 1 G and Fig. 1 H, be appreciated that the PiP screen can be included in optional position or the regional screen that covers another screen of going up in the physical display.
Fig. 2 illustrates the diagrammatic sketch of the relation between the logical screen and display screen according to an exemplary embodiment of the present invention.
With reference to Fig. 2, can use logical screen 210,212 and 214 to show service.Logical screen 210,212 and 214 is mapped to display screen 220,222,224 by mapping block 230.
At length, logical screen 210,212 is mapped to display screen 220, and logical screen 212 and 214 is mapped to display screen 222, and logical screen 210,212 and 214 is mapped to display screen 224.
In brief, show that at least one logical screen of service is mapped to the arbitrary region of display screen.
In addition, as shown in Figure 3, the service that is provided by various services source can be displayed on the display screen, and display screen can be displayed on the physical display.
Exist provide broadcast service (such as, terrestrial broadcasting radio station 320 and wired broadcasting station) the service source, service source that is stored in the service in the storage medium (personal video recorder (PVR) 340) and the service source (not shown in Figure 15) that service is provided via cable network or wireless network are provided.
Then, use predefined method or, any service directly is set will being displayed on the display screen that shows on the physical display by user or the method that use to be provided with.Otherwise, be mapped on the display screen at least one logical screen of arbitrary region and be displayed on the physical display 350.In brief, the service that provides of terrestrial broadcasting radio station 320, wired broadcasting station 330 and PVR is displayed on the physical display 350.
The radio station of terrestrial broadcasting shown in Fig. 3 320, wired broadcasting station 330 and PVR340 still the invention is not restricted to this as the service source.According to an exemplary embodiment of the present, providing the content of multimedia source of any kind of the content of multimedia that can be shown together can be the service source.
Shown in Fig. 4 A and Fig. 4 B, service can be classified as abstract service and non-abstract service according to an exemplary embodiment of the present invention.
Abstract service is not the service that the broadcast singal by real-time transmission provides, but is independent of the service of broadcast channel.Abstract service only comprises data component (that is, using), and does not have video component and audio component.The example of abstract service comprises the not service of the application of binding that has based on the OCAP standard.
Non-abstract service is understood that the service except that abstract service.
According to current exemplary embodiment of the present invention, abstract service and non-abstract service have independence.For example, abstract service can directly not be set on the physical display by logical screen, and non-abstract service can be displayed on the logical screen.Then, logical screen can be mapped to the display screen that abstract service wherein is set.Afterwards, display screen can be output by physical display.Like this, abstract service can be independent of non-abstract service and is displayed on the display screen.In addition, abstract service can be mapped to different logical screens with non-abstract service.Afterwards, logical screen can be mapped to single display screen.In other words, abstract service can be independent of non-abstract service and is displayed on the display screen.
According to current exemplary embodiment of the present invention, logical screen can be classified as different objects with display screen.Perhaps, screen can be used as logical screen or display screen according to the attribute information of a screen object.
At length, if having predefined value with the corresponding screen object attribute of the characteristic of logical screen, other screen object attributes have fixed value, and then screen object can be used as logical screen.On the other hand, if having predefined value with the corresponding screen object attribute of the characteristic of display screen, other screen object attributes have fixed value, and then screen object can be used as display screen.
The attribute information of screen object comprises a plurality of attributes " type ", " z-Order ", " Display_Area ", " Visibility ", " Associated_Display_Screen ", " Associated_Service_Contexts ", " Associated_Logical_Screens " and " OutputPort ".
If attribute " z-Order ", " Display_Area ", " Visibility ", " Associated_Display_Screen " and " Associated_Service_Contexts " have predefined value and attribute " Associated_Logical_Screens " and " OutputPort " and have fixed value, then screen object can be used as logical screen.
On the other hand, if attribute " Associated_Service_Contexts ", " Associated_Logical_Screens " and " OutputPort " have predefined value and attribute " z-Order ", " Display_Area ", " Visibility " and " Associated_Display_Screen " has fixed value, then object video can be used as display screen.
Fig. 5 illustrates the screen object of the attribute that is used to handle screen and the attribute information of interface.
With reference to Fig. 5, attribute " z-Order " the 510th is used for determining a plurality of logical screens with what order are arranged along the z axle.Fig. 6 A and Fig. 6 B illustrate the different configurations of the logical screen on the physical display of various combination of value of attribute of " z-Order " that be used for logical screen.
With reference to Fig. 6 A, first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610 respectively.At length, first logical screen 620 is displayed on the display screen 610, and second logical screen 630 is displayed on the display screen that part covers first logical screen 620.In other words, display screen 610, first logical screen 620 and second logical screen 630 are sequentially arranged with the direction of z axle.In this case, the attribute " z-Order " that the attribute of first logical screen 620 " z-Order " can the value of being set to 1, the second logical screen 630 can the value of being set to 2.The attribute " z-Order " of first logical screen 620 and second logical screen 630 can be set to any numeral and character, as long as the particular order that on behalf of first logical screen 620 and second logical screen 630, they can arrange along the z axle.
With reference to Fig. 6 B, when the attribute " z-Order " of first logical screen 620 shown in Fig. 6 A from 1 attribute " z-Order " of changing into 2 and second logical screen 630 when 2 change into 1, first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610 respectively.In this case, display screen 610, first logical screen 620 and second logical screen 630 are worth along z direction of principal axis sequence arrangement according to the attribute " z-Order " that changes.
As mentioned above, attribute " z-Order " value is indicated the order that a plurality of logical screens are arranged.The order that attribute " z-Order " also can indicate the component of logical screen or display screen to be arranged.
For example, as mentioned above, logical screen or display screen can be the combinations of stationary background image, video raster and figure grating.For the convenience of describing, provide the stationary background image (such as, background image) example (or object) will be called as " HBackgroundDevice ", provide video (such as, motion picture) example (or object) will be called as " HVideoDevice ", provide the example (or object) of figure (such as, application data) will be called as " HGraphicsDevice ".In addition, example (or object) " HBackgroundDevice ", " HVideoDevice " and " HGraphicsDevice " will be collectively referred to as " HScreenDevice " respectively.
Here, can determine the order that the example " HScreenDevice " of logical screen or display screen is arranged along the z direction of principal axis.
Preferably, " HBackgroundDevice ", " HVideoDevice " and " HGraphicsDevice " can be by sequence arrangement.Therefore, attribute " z-Order " value of example " HVideoDevice " is greater than attribute " z-Order " value of example " HBackgroundDevice ", and the attribute " z-Order " of example " HGraphicsDevice " value is greater than attribute " z-Order " value of example " HVideoDevice ".
If there is example " HBackgroundDevice " in current screen, then attribute " z-Order " value that (begins at current screen backmost) example " HBackgroundDevice " placed bottom from spectators' viewpoint at current screen is zero.
Have if current screen does not have example " HBackgroundDevice " " HVideoDevice ", then attribute " z-Order " value of the example of placing in (from spectators' viewpoint at current screen backmost) bottom of current screen " HVideoDevice " is zero.
If current screen does not have example " HBackgroundDevice ", also do not have example " HVideoDevice ", then attribute " z-Order " value of the example of placing in (from spectators' viewpoint at current screen backmost) bottom of current screen " HGraphicsDevice " is zero.
In addition, attribute " z-Order " value that is included in the example " HVideoDevice " in the current screen is greater than attribute " z-Order " value that is included in any example " HBackgroundDevice " in the current screen, and attribute " z-Order " value that is included in the example " HGraphicsDevice " in the current screen is greater than attribute " z-Order " value that is included in any example " HVideoDevice " in the current screen.Because these examples " HScreenDevice " with bigger attribute " z-Order " value are placed on more the front near current screen, so they and spectators' distance is nearer.
Although example " HBackgroundDevice ", " HVideoDevice " and " HGraphicsDevice " are arranged with as above predetermined order, can determine the putting in order of example " HScreenDevice " of same type arbitrarily.
As will illustrating at Fig. 8 A and Fig. 8 B, attribute " Display_Area " the 520th is about the information in the display screen zone of logical screen.
Fig. 7 A illustrates the whole zone that logical screen 710 is mapped to display screen 720, and Fig. 7 B illustrates the subregion that logical screen 730 is mapped to display screen 740.
Attribute " Display_Area " can comprise specifies logical screen that the information of the two-dimensional coordinate of the predetermined portions of the display screen that is mapped to can be comprised that maybe what deviant the information of specifying the precalculated position on the display screen and indication logical screen precalculated position from the display screen depart from.
Attribute " Visibility " 530 determines that logical screen still invisibly is presented on the display screen visibly.Can logical screen be appeared on the display screen or from display screen by the value that changes attribute " Visibility " 530 disappears.
Attribute " Associated_Display_Screen " the 540th is about the information of the display screen relevant with logical screen.Can not be presented at physical display or not be sent to outside output device with all incoherent logical screen of any display screen.
Attribute " Associated_Service_Contexts " the 550th is about the information of the service context that is connected to logical screen or display screen.The service that is arranged on this service context can be displayed on logical screen or the display screen.
Attribute " Associated_Logical_Screens " the 560th is about the information of the logical screen relevant with display screen.
Attribute " OutputPort " the 570th, the information of the device that will be output about display screen, and this device comprises display screen, wire/wireless communication medium and various storage medium.
Can be provided for discerning or changing the interface of the value of the attribute shown in Fig. 5.With reference to Fig. 5, described interface can comprise be used to set property or with logical screen be connected to display screen interface " SET ", be used to add property value or with logical screen be connected to service interface " ADD ", be used for the interface " GET " of recognition property value and be used for the interface " REMOVE " of delete property value.These interfaces can comprise processing, function, process respectively or carry out the method for their function.
For example, method " setZOrder (int order) " is provided with or changes above-mentioned attribute " z-Order ".Parameter " order " is meant that expression works as the attribute information of logical screen order of display logic screen when being presented on the display screen.At length, method " setZOrder (int order) " is to be used to set a property the interface that is provided with of " z-Order ".
Can carry out the abnormal operation of method " setZOrder (int order) ".At current screen is not that the attribute " z-Order " of logical screen or current screen is because hardware or software feature and carry out this abnormal operation can't change the time.
Corresponding to method " setZOrder (int order) ", method " getZOrder (void) " is at the attribute information that need not to provide under the situation of any parameter " z-Order " on current screen, and returns non-negative " z-Order " value.If current screen is a display screen, then preferably, method " getZOrder (void) " returns 0, and logical screen has the natural number greater than 1.Method " getZOrder (void) " be used for getattr " z-Order " information obtain interface.
In addition, method " setZOrder (HScreenDevice[]) " is provided with or changes attribute " z-Order " value of the example " HScreenDevice " in logical screen or the display screen.The parameter of method " setZOrder (HScreenDevice[]) " is the set of attribute " z-Order " the value example " HScreenDevice " that will be set up or change.At length, method " setZOrder (HScreenDevice[]) " be used to be provided with example " HScreenDevice " " z-Order " attribute information interface is set.
Can carry out the abnormal operation of method " setZOrder (HScreenDevice[]) ".The attribute " z-Order " of the example in current screen " HScreenDevice " is owing to provide the hardware of equipment of multi-screen or software feature and carry out this abnormal operation can't change the time.
Corresponding to method " setZOrder (HScreenDevice[]) ", method " getZOrder (HScreenDevice[]) " attribute information of " z-Order " of example " HScreenDevice " is provided in current logical screen or display screen, and return non-negative " z-Order " value.Method " getZOrder (HScreenDevice[]) " be the attribute " z-Order " that is used to obtain example " HScreenDevice " information obtain interface.
According to another example, method " getDisplayScreen (void) " is returned the display screen relevant with current screen.At length, if current screen is a logical screen, then method " getDisplayScreen (void) " is returned relevant display screen.If current screen is a display screen, then method " getDisplayScreen (void) " is returned the reference information about current screen.In addition, if current screen is a logical screen, but there are not screen associated, then method " getDisplayScreen (void) " return value " NULL ".
According to another example, method " public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException " is provided for current logical screen is mapped to the function of the presumptive area of relevant display screen.The example that is provided as parameter belongs to the class " HScreenRectangle " of bag " org.havi.ui ", and has two-dimensional position information.The abnormal operation that the execution of method " SecurityException " and " IllegalStateException " can be used as method " setOutputScreen (HScreen screen) " carries out.When current screen during logical screen or at a part of display screen relevant with current logical screen because the characteristic of host platform and can not change the time, executing method " IllegalStateException ".
According to another example of the present invention, method " getOutputArea (void) " is returned the area information of current screen as HScreenRectangle information.If current screen and display screen are corresponding, then method " getOutputArea (void) " is returned the HScreenRectangle information that has with the identical value of HScreenRectangle (0,0,1,1).If current screen is a logical screen, method getOutputArea (void) then " return the information in the zone on the display screen that occupies about current screen.If current screen is a logical screen, but not relevant with any display screen, method getDisplayArea (void) then " return value " NULL ".
The particular term that runs through following description use relates to special interface.Yet, it will be appreciated by those skilled in the art that the name specific function only is used to indicate its function.The detailed description of exemplary embodiment does not attempt to distinguish title rather than the different function of function.
Fig. 8 illustrates two services to be set at and will to be mapped to the diagrammatic sketch of the processing on the display screen of single display screen.
With reference to Fig. 8, first service comprises whole three service component (that is, video, audio frequency and data component), and second service only comprises video and audio component.Yet the present invention can not apply any restriction to service component, and the service of first shown in Fig. 8 and second service are exemplary.
As shown in Figure 8, first service and second service are to be presented on the physical display with prior art mode much at one.According to current exemplary embodiment of the present invention, can independently of one another a plurality of services be presented on the physical display, and need not apply any restriction the quantity that can be displayed on the service on the single display screen.
Fig. 9 is the block diagram that the equipment of multi-screen is provided according to an exemplary embodiment of the present invention.
With reference to Fig. 9, be used to provide the equipment 900 of multi-screen to comprise digital signal processing module 940, service processing module 950, output module 960 and user/AIM 965.
And described equipment 900 comprises broadcast singal receiver module 910, storage medium 920 and the outside input module 930 as the service source, and comprises physical display 970, storage medium 980 and outside output module 990 as the service output medium.
As used in this, term " module " means, but be not limited to the software of carrying out particular task or nextport hardware component NextPort (such as, programmable gate array (FPGA) or application-specific integrated circuit (ASIC) (ASIC)).Advantageously, module can be configured to reside on addressable storage medium, and is configured to and will carries out on one or more processors.Therefore, for example, module can comprise assembly (such as, component software, OO component software, class component and task component), processing, function, attribute, process, subprogram, program code segments, driver, firmware, microcode, circuit, data, database, form, array and variable.The function that provides in assembly and module can be combined into less assembly and module, or is separated into extra assembly and module in addition.
The various information that digital signal processing module 940 is served from broadcast singal receiver module 910, storage medium 920 or 930 receptions of outside input module (such as, content of multimedia (for example, video information, audio-frequency information or data message)).
Broadcast singal receiver module 910 receives satellite, ground or cable broadcasting signal and sends the broadcast singal that receives, video information, audio-frequency information or the data message of storage medium 920 stores service, outside input module 930 from external device (ED) (such as, be connected to the network of network interface module) receive video information, audio-frequency information or the data message of service.
Digital signal processing module 940 uses the service component that receives to recover a plurality of services.The service of storage comprises abstract or non-abstract service.
Here, phrase " a plurality of service " is meant two or more services that sent by broadcast singal receiver module 910, or two or more services that sent respectively by broadcast singal receiver module 910 and storage medium 920.
Digital signal processing module 940 can recover a plurality of services according to user or the selection of using the help by user/AIM 965.In this case, user or application can be selected the connection between service arbitrarily and the screen.
The display screen that output module 960 provides can be displayed on the physical display 970 and maybe can be stored in the storage medium 980.The example of storage medium 980 comprises computer-readable floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, BD (Blu-ray disc) and semiconductor memory.
And the display screen that output module 960 provides can be sent to the external device (ED) that is connected to network via outside output module 990.
For this reason, output module 960 can comprise a plurality of output ports, provides display screen via described output port.In this case, can provide display screen via the output port or the output port selected by the help of user/AIM 965 of user that set in advance as acquiescence.
The service that user or application can use user/AIM 965 to select in a plurality of services or recover to expect.And the user can use in a plurality of display screens of user/AIM 965 selections.
Because the module shown in Fig. 9 is divided according to their function, therefore can be connected to other modules.
Figure 10 illustrates according to an exemplary embodiment of the present invention the dynamically flow chart of the method for configuring multiple screens.
Usually, video information, audio-frequency information and the data message of composition content of multimedia are sent out with predetermined form (for example, mpeg stream form).At operation S1010, be used to provide such as equipment receiver, video information, audio-frequency information and the data message of the service of content of multimedia and based on video information, audio-frequency information and data message and recover service.Here, can or pre-determine the service that recovers at operation S1010 by user or application choice.The user can use the menu that is presented on the display unit or remote controller to select connection between any screen and the screen.Application can use API to select to connect.
In addition, data message comprises the application message about the application program of service, and these application messages comprise the signal message whether the indication application program can be carried out on the PiP screen.The example of application message comprises based on the application information table of MHP standard (AIT) with based on the application information table (XAIT) of the expansion of OCAP standard.Signal message can be added to application message.
Afterwards, at operation S1020, the service of recovery is set up, thereby this service can be displayed on the logical screen.At step S1030, logical screen is mapped to display screen.At step S1040, use display unit, storage medium or network that display screen is offered the user.
For simply, the service that recovers shown in Figure 10, it is presented on the physical display via logical screen.Yet the service of recovery can directly be displayed on the physical display, and need not to pass through logical screen.
When the user selects the PiP service, realize the PiP service with two kinds of patterns.Under first pattern, only be provided at the video component of the PiP service of selecting on the main screen, and do not create the independent logical screen (PiP screen just) that is used for the PiP service.Under second pattern, create the PiP service of independent logical screen that is used for the PiP service to select on the PiP screen that is provided at establishment.
Figure 10 illustrates for simple only with the method for a map of services to display screen.Yet by a plurality of logical screens or need not by a plurality of logical screens, a plurality of services can be mapped to display screen.
When by this way display screen being offered the user, the user can carry out a plurality of services.
Figure 11 is the diagrammatic sketch that the software architecture that is used to provide multi-screen according to an exemplary embodiment of the present invention is shown.
With reference to Figure 11, software architecture 1100 comprises device Drive Layer 1110, api layer 1120 and application layer 1130.
The help of user by application layer 1130 makes device Drive Layer 1110 provide display screen via physical display or display screen is stored in the storage medium.In addition, the user can make device Drive Layer 1110 via network display screen be sent to external device (ED).
For this reason, device Drive Layer 1110 can comprise a plurality of ports that display screen can be provided.Otherwise api layer 1120 can comprise a plurality of output ports.
In order on display screen, dynamically to dispose a plurality of logical screens, as shown in figure 12, api layer 1120 can comprise a plurality of software modules (for example, multi-screen manager module " MultiScreenManager " 1210, multi-screen context module " MultiScreenContext " 1230, multi-screen context detectaphone module " MultiScreenContextListener " 1250 and multi-screen context events module " MultiScreenContextEvent " 1240.
When multi-screen context module 1230 changes the attribute information of screen object 1220, multi-screen context events module 1240 is as the reformed event class of attribute information of notification screen object 1220, and multi-screen context detectaphone module 1250 is as the detectaphone interface object that can realize with the predetermined application class of attempting to receive the incident that multi-screen context events module 1240 proposes.
Using 1260 is driven modules on application layer 1130.Using 1260 allows the user to select the service of expecting and freely arrange a plurality of logical screens on display screen.
At length, use 1260 various command sent to multi-screen manager module 1210, described order allows the user dynamically to dispose and the management logic screen, and multi-screen manager module 1210 is controlled and will be operated accordingly by the various command that multi-screen context module 1230 is performed.
Multi-screen manager module 1210 (not shown) receive the service component that is provided by various services source from device Drive Layer 1110, and executable operations is presented on logical screen or the display screen with the service component that will receive.
Figure 13 illustrates according to an exemplary embodiment of the present invention by the module shown in Figure 12 at the flow chart that is presented at a plurality of service method that show on each corresponding logical screen on the display screen.
With reference to Figure 13, at operation S1310, multi-screen manager module 1210 produce display screens and with the logical screen of the corresponding quantity of quantity of the service that will be performed.
At operation S1320, multi-screen manager module 1210 is connected to logical screen each respective service that receives from device Drive Layer 1110.Multi-screen manager module 1210 can be set to the parameter of logical screen service by the service context object of the service that receives, comes each logical screen call method " addServiceContexts ".Method " addServiceContexts " is connected to service with logical screen, and can be provided by multi-screen context module 1230.
In operation 1330, in case logical screen is connected to each service, multi-screen manager module 1210 is connected to display screen with logical screen.At this moment, multi-screen manager module 1210 can be set to parameter by the display screen that logical screen is connected to each logical screen call method " setDisplayScreen ".Method " setDisplayScreen " is connected to display screen with logical screen, and can be provided by multi-screen context module 1230.
Method " setDisplayScreen " can be set to " public void setDisplayArea (HScreenscreen) throws SecurityException; IllegalStateException ", and the example " HScreen " that this method permission is provided as parameter is relevant with current logical screen.In this case, preferably, example " HScreen " is a display screen.
The parameter of method " setDisplayArea (HScreen screen) " can comprise value " NULL ".In this case, during manner of execution " setDisplayArea (HScreen screen) ", current logical screen is no longer relevant with display screen when need not abnormality processing.
The abnormal operation that method " SecurityException " and " IllegalStateException " can be used as method " setDisplayArea (HScreen screen) " carries out.
When current screen is logical screen or at the part display screen relevant with current logical screen because the characteristic of host platform and can not change the time, method " IllegalStateException " can be performed.
At operation S1340, the zone on the display screen that logical screen will be mapped to respectively is determined.At this moment, can call the preordering method that provides by multi-screen context module 1230 to determine that logical screen is with the zone on the display screen that is shown.
Figure 14 illustrates to exchange the flow chart that is presented at the service method on the logical screen between the exemplary embodiment according to the present invention module shown in Figure 12.
In operation S1410, the service that the 1210 interim terminations of multi-screen manager module will exchange between two logical screens.
Afterwards, at operation S1420, will between two logical screens, be exchanged about the information of serving.At this moment, to each call method " removeServiceContexts " in two logical screens and method " addServiceContexts ", thereby exchanging the service context that in two logical screens, is provided with between two logical screens.Method " removeServiceContexts " is removed the service context that is connected to logical screen, and method " addServiceContexts " is added new service context to logical screen.Can provide method " removeServiceContexts " and method " addServiceContexts " by multi-screen context module 1230.According to current exemplary embodiment of the present invention, the information on services that is connected to the service of logical screen is exchanged between logical screen, thereby obtains the effect of exchange main screen and sub-screen.In addition, according to current exemplary embodiment of the present invention, even when on display screen, carrying out three or more service, also can between any amount of logical screen, exchange these services.
At operation S1430, the connection generation of reformed incident between the service of producing and two logical screens.Afterwards, at operation S1440, multi-screen context events module 1240 sends to multi-screen context detectaphone module 1250 with incident, and the service that reconnects to two logical screens begins to be performed.
Utilizability on the industry
According to exemplary embodiment of the present invention, can use the single physical display unit to carry out a plurality of services that each provenance (such as, wired broadcasting, terrestrial broadcasting, various storage medium and outside input) provides according to variety of way.
Although illustrate and described the present invention particularly with reference to exemplary embodiment of the present invention, but those skilled in the art will appreciate that, under the situation that does not break away from the spirit and scope of the present invention that are defined by the claims, can carry out the various changes on form and the details.Therefore, will understand, it only is descriptive that above-mentioned exemplary embodiment is provided, and should not be understood that any restriction of applying of scope of the present invention.
Claims (12)
1, a kind of equipment that multi-screen is provided, described equipment comprises:
Digital signal processing module, at least one in receiver, video information, audio-frequency information and the data message also recovered a plurality of services based in video information, audio-frequency information and the data message at least one;
Service processing module produces a plurality of logical screens of display screen and the service that is used to show that digital signal processing module recovers; And
Output module, a plurality of logical screens that service processing module is provided are mapped to the diverse location on the display screen,
Wherein, in described a plurality of logical screen each comprises at least one in stationary background image, video raster and the figure grating, and in described a plurality of logical screen each has indication and arranges at least one the attribute information of order in stationary background image, video raster and the figure grating that is included in the logical screen.
2, equipment as claimed in claim 1, wherein, if logical screen comprises the stationary background image, then attribute information indication stationary background image is positioned at the last of logical screen.
3, equipment as claimed in claim 1 wherein, does not comprise the stationary background image if logical screen comprises video raster, then attribute information instruction video grating is positioned at the last of logical screen.
4, equipment as claimed in claim 1, wherein, if logical screen comprises the figure grating and does not comprise stationary background image and video raster that then attribute information indicating graphic grating is positioned at the last of logical screen.
5, equipment as claimed in claim 1, wherein, the attribute information value of video raster is greater than the stationary background attributes of images value of information, and compares with the stationary background image, and video raster is positioned at the position of the front of more approaching logical screen.
6, equipment as claimed in claim 1, wherein, the attribute information value of figure grating is greater than the attribute information value of video raster, and compares with video raster, and the figure grating is positioned at the position of the front of more approaching logical screen.
7, a kind of method that multi-screen is provided, described method comprises:
In receiver, video information, audio-frequency information and the data message at least one;
Recover a plurality of services based in the video information, audio-frequency information and the data message that receive at least one;
Produce display screen and be used to show a plurality of logical screens of the service of recovery; And
A plurality of logical screens are mapped to diverse location on the display screen,
Wherein, in described a plurality of logical screen each comprises at least one in stationary background image, video raster and the figure grating, and in described a plurality of logical screen each has indication and arranges at least one the attribute information of order in stationary background image, video raster and the figure grating that is included in the logical screen.
8, method as claimed in claim 7, wherein, if logical screen comprises the stationary background image, then attribute information indication stationary background image is positioned at the last of logical screen.
9, method as claimed in claim 7 wherein, does not comprise the stationary background image if logical screen comprises video raster, then attribute information instruction video grating is positioned at the last of logical screen.
10, method as claimed in claim 7, wherein, if logical screen comprises the figure grating and does not comprise stationary background image and video raster that then attribute information indicating graphic grating is positioned at the last of logical screen.
11, method as claimed in claim 7, wherein, the attribute information value of video raster is greater than the stationary background attributes of images value of information, and compares with the stationary background image, and video raster is positioned at the position of the front of more approaching logical screen.
12, method as claimed in claim 7, wherein, the attribute information value of figure grating is greater than the attribute information value of video raster, and compares with video raster, and the figure grating is positioned at the position of the front of more approaching logical screen.
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US78957706P | 2006-04-06 | 2006-04-06 | |
| US60/789,577 | 2006-04-06 | ||
| US60/812,090 | 2006-06-09 | ||
| US60/870,471 | 2006-12-18 | ||
| KR1020070019230 | 2007-02-26 | ||
| US60/918,894 | 2007-03-20 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101416497A true CN101416497A (en) | 2009-04-22 |
Family
ID=40595676
Family Applications (11)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Family Applications Before (9)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Country Status (1)
| Country | Link |
|---|---|
| CN (11) | CN101416490A (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101763842B (en) * | 2009-11-13 | 2012-07-11 | 广东威创视讯科技股份有限公司 | Spliced wall body allocation system and position mapping method for establishing display units |
| KR101743776B1 (en) | 2010-09-28 | 2017-06-05 | 엘지전자 주식회사 | Display apparatus, method thereof and method for transmitting multimedia |
| CN103176684B (en) | 2011-12-22 | 2016-09-07 | 中兴通讯股份有限公司 | A kind of method and device of multizone interface switching |
| US9632648B2 (en) | 2012-07-06 | 2017-04-25 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
| CN103631551A (en) * | 2012-08-27 | 2014-03-12 | 深圳市蓝韵网络有限公司 | Local display method for remote desktop in medical consultation system |
| KR102069547B1 (en) * | 2013-04-19 | 2020-01-28 | 삼성전자주식회사 | Method and apparatus for transmitting and receiving additional information in a broadcast communication system |
| US20180012570A1 (en) * | 2016-07-07 | 2018-01-11 | Futurewei Technologies, Inc. | Apparatus and method for mapping frame buffers to logical displays |
| CN111045622B (en) * | 2019-11-21 | 2023-06-30 | 中国航空工业集团公司西安航空计算技术研究所 | Object-oriented display control interface model |
-
2007
- 2007-04-04 CN CNA2007800120942A patent/CN101416490A/en active Pending
- 2007-04-05 CN CNA2007800121837A patent/CN101416492A/en active Pending
- 2007-04-05 CN CNA2007800121926A patent/CN101416493A/en active Pending
- 2007-04-05 CN CNA2007800120317A patent/CN101416489A/en active Pending
- 2007-04-05 CN CNA2007800122149A patent/CN101416494A/en active Pending
- 2007-04-05 CN CNA2007800121146A patent/CN101416491A/en active Pending
- 2007-04-05 CN CNA2007800124017A patent/CN101416496A/en active Pending
- 2007-04-05 CN CNA2007800123118A patent/CN101416495A/en active Pending
- 2007-04-05 CN CNA2007800120213A patent/CN101416488A/en active Pending
- 2007-04-05 CN CNA2007800124144A patent/CN101416497A/en active Pending
- 2007-04-05 CN CNA2007800120143A patent/CN101416487A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| CN101416491A (en) | 2009-04-22 |
| CN101416496A (en) | 2009-04-22 |
| CN101416494A (en) | 2009-04-22 |
| CN101416495A (en) | 2009-04-22 |
| CN101416489A (en) | 2009-04-22 |
| CN101416493A (en) | 2009-04-22 |
| CN101416487A (en) | 2009-04-22 |
| CN101416488A (en) | 2009-04-22 |
| CN101416492A (en) | 2009-04-22 |
| CN101416490A (en) | 2009-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101238721B (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| KR20080030977A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| CN101416497A (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| KR100846790B1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR100791302B1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| CA2648960A1 (en) | Apparatus and method for identifying an application in the multiple screens environment | |
| KR100900973B1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR20070100110A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| WO2007114669A1 (en) | Apparatus and method for identifying an application in the multiple screens environment | |
| WO2007114666A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| WO2007114673A1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| JP2009503604A (en) | Apparatus for providing a multi-screen and a method for dynamically configuring the multi-screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |