CN101416496A - Apparatus for providing multiple screens and method of dynamically configuring multiple screens - Google Patents
Apparatus for providing multiple screens and method of dynamically configuring multiple screens Download PDFInfo
- Publication number
- CN101416496A CN101416496A CNA2007800124017A CN200780012401A CN101416496A CN 101416496 A CN101416496 A CN 101416496A CN A2007800124017 A CNA2007800124017 A CN A2007800124017A CN 200780012401 A CN200780012401 A CN 200780012401A CN 101416496 A CN101416496 A CN 101416496A
- Authority
- CN
- China
- Prior art keywords
- screen
- logical
- service
- module
- output port
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
An apparatus for providing multiple screens and a method of dynamically configuring multiple screens is disclosed. The apparatus for providing multiple screens is capable of connecting a plurality of screens to a plurality of output ports so as to dynamically configure the plurality of screens which provide multiple contents on a single physical display device. The apparatus for providing multiple screens includes a service processing module which generates a plurality of screens for displaying received service and an output module which searches an output port connected to the screen.
Description
Technical field
Apparatus and method according to the invention relates to be provided and the dynamic-configuration multi-screen, more particularly, relates to multi-screen is connected to a plurality of output ports, and the multi-screen of a plurality of contents is provided with dynamic-configuration on the single physical display unit.
Background technology
The broadcasting receiver of prior art (for example, Digital Television (TV) or top box of digital machine) only provides a content element on the single physical display unit, perhaps show main screen and sub-screen on the single physical display unit simultaneously.
Even the broadcasting receiver of prior art can show main screen and sub-screen simultaneously on same display screen, also can only arrange main screen and sub-screen with the number limited mode.When displaying contents in the demonstration main screen, all elements of displaying contents (that is, video data, voice data and other data).On the other hand, when displaying contents in sub-screen, some elements of a displaying contents.
Content source comprises broadcast service (for example, satellite broadcasting device, terrestrial broadcasting device or wired broadcasting device), storage medium (for example, digital universal disc (DVD)) or is connected to the external device (ED) of input terminal.Yet, be very difficult to by using existing broadcasting receiver on display screen, to show the content that various content source provide.
In interactive TV application environment (for example, MHP (MHP), senior common application platform (ACAP) and open cable application platform (OCAP)), suppose on physical display, only to export a screen.
In interactive TV application environment, for example, adopt user interface (UI) based on home audio/video interoperability (HAVi).According to HAVi UI standard,, on physical display, also can only show a screen usually even the quantity of the screen that shows on the physical display is not applied restriction.
Summary of the invention
Technical problem
In this environment, on independent screen, show in the content of multimedia, be difficult to one of content of multimedia executable operations (for example, decoding, Digital Signal Processing, user interaction process etc.) about showing on the screen.In addition, also be difficult to the life cycle of dynamic controlling application program and to be difficult to the screen be that unit uses resource.
Therefore, need a kind of a plurality of service method that on the screen of dynamic-configuration, show.
Technical scheme
The invention provides a kind of on physical display the equipment and the method for dynamic-configuration multi-screen, described multi-screen provides a plurality of contents.
According to an aspect of the present invention, provide a kind of equipment that is used to provide multi-screen.Described equipment comprises: service processing module produces a plurality of logical screens that are used to show a plurality of services; Output module will comprise that at least one the logical screen combination in described a plurality of logical screen is mapped to output port.
A kind of method of dynamic-configuration multi-screen is provided according to a further aspect in the invention.Described method comprises: produce a plurality of logical screens that are used to show a plurality of services; To comprise that at least one the logical screen combination in described a plurality of logical screen is mapped to output port.
Description of drawings
By the detailed description of reference accompanying drawing to exemplary embodiment of the present, above and other aspect of the present invention will become clearer, wherein:
Figure 1A to Fig. 1 H illustrates the diagrammatic sketch of the structure of PiP screen according to an exemplary embodiment of the present invention;
Fig. 2 illustrates the diagrammatic sketch of the relation between the logical screen and display screen according to an exemplary embodiment of the present invention;
Fig. 3 A to Fig. 3 E is the diagrammatic sketch that the structure of the screen that comprises mapper according to an exemplary embodiment of the present invention is shown;
Fig. 4 illustrates the block diagram of serving the source according to an exemplary embodiment of the present invention;
Fig. 5 A and Fig. 5 B are the diagrammatic sketch that non-according to an exemplary embodiment of the present invention abstract service and abstract service are shown;
Fig. 6 illustrates the attribute information of logical screen and display screen and the diagrammatic sketch at interface;
Fig. 7 illustrates the diagrammatic sketch of the attribute of logical screen " z-order " according to an exemplary embodiment of the present invention;
Among Fig. 8 A and Fig. 8 B each all is that the diagrammatic sketch of the attribute of logical screen " Display_Area " according to an exemplary embodiment of the present invention is shown;
Fig. 9 illustrates according to an exemplary embodiment of the present invention with the diagrammatic sketch of two map of services to the method for display screen;
Figure 10 is the block diagram that the structure of the equipment that multi-screen is provided according to an exemplary embodiment of the present invention is shown;
Figure 11 A and 11B illustrate the flow chart of the method for dynamic-configuration multi-screen according to an exemplary embodiment of the present invention;
Figure 12 is the diagrammatic sketch that the software architecture that multi-screen is provided according to an exemplary embodiment of the present invention is shown;
Figure 13 is the diagrammatic sketch that the relation between the module that constitutes application programming interfaces (API) layer according to an exemplary embodiment of the present invention is shown;
Figure 14 illustrates the flow chart that is shown the processing of a plurality of services according to an exemplary embodiment of the present invention by module shown in Figure 13 by logical screen on display screen;
Figure 15 illustrates the state diagram of the operation of output module according to an exemplary embodiment of the present invention;
Figure 16 A and Figure 16 B illustrate the diagrammatic sketch of example that is used to according to an exemplary embodiment of the present invention to search for and changes the code of output port;
Figure 17 illustrates the flow chart that is changed the processing of a plurality of services that show on the logical screen according to an exemplary embodiment of the present invention by the module shown in Figure 13.
Embodiment
By with reference to following the detailed description and the accompanying drawings, can be more readily understood advantages and features of the invention and its implementation to exemplary embodiment.Yet, can the present invention should be interpreted as being limited to the exemplary embodiment of setting forth here with many multi-form the present invention that implement.On the contrary, providing these exemplary embodiments to make the disclosure is completely with complete, and design of the present invention is conveyed to those skilled in the art fully, and only is defined by the claims the present invention.In whole specification, identical label is represented identical parts.
Hereinafter with reference to describing the present invention according to the user interface of exemplary embodiment of the present invention, the flow chart of method and computer program product.To understand, each square frame of flow chart and the combination of the square frame in flow chart can be realized by computer program instructions.The processor that these computer program instructions can be provided for all-purpose computer, special-purpose computer or other programmable data processing device to be producing machine, thereby the means that are used for being implemented in the function that a flowchart block or a plurality of flowchart block describe are created in the instruction carried out of the processor of machine or other programmable data processing device as calculated.
These computer program instructions also can be stored in can instruct computer or other programmable data processing device with the computer of ad hoc fashion work can with or computer-readable memory in so that be stored in computer can with or computer-readable memory in instruction production comprise the product of the instruction means of the function that execution is described in a flowchart block or a plurality of flowchart block.
Computer program instructions also can be written into computer or other programmable data processing device so that the sequence of operations step is performed producing the process that computer is carried out on computer or other programmable devices, thereby the instruction of carrying out on computer or other programmable devices is provided for being implemented in the step of the function of describing in a flowchart block or a plurality of flowchart block.
But the part of each square frame representation module, code segment or the code of flow chart, it comprises one or more executable instructions that are used to realize specific logical function.Should also be noted that the function of mentioning can not occur in order in some selectable realizations in square frame.For example, according to related function, in fact two square frames that show may take place basically simultaneously continuously, and perhaps described square frame may be performed with opposite order sometimes.
In order to understand the present invention better, define the term that uses in the disclosure now.
One group of content of multimedia that term " service " indication shows together, i.e. one group of service component.
The service component is the element of service, and comprises video component, audio frequency component and data component.Data component is the application program in the service.
In addition, application program can be categorized as not binding application program and service binding application program.Because binding application program does not have high priority, so resource is distributed reposefully.The monitor application program is corresponding to the specific not binding application program with limit priority.
The service binding application program is relevant with transport stream, and allows priority to be lower than the not priority of binding application program.The service binding application program is not as critical system.When resource contention occurring, service binding application program ratio not binding application program has the possibility that bigger relinquishes resources is distributed.The service binding application program comprises the union type of operating together with the stream that just is being transmitted and is independent of the described non-union type that flows to line operate.
The object of the execution of term " service context " indication may command service comprises various resources, installs and provides service required execution state information.
The physical space of the content of term " physical display " indication actual displayed service.
The screen of term " display screen " indication actual displayed on physical display.On display screen, any service can be set directly, on physical display, can show display screen.At least one logical screen that selectively, on physical display, can show the specific region that is mapped to display screen.
Term " logical screen " indicated number is the space of service arbitrarily.Therefore logical screen is the virtual screen before being mapped to display screen, display logic screen not on physical display.
Logical screen and display screen can be the combinations of stationary background image, video raster and figure grating.The figure grating can be the combination of text, row, color and image, perhaps can be the mixing of frame of video.
Term " main service " is indicated by the menu that shows on the physical display or by the user and is passed through remote controller, and perhaps selected as main service of serving by the API of application program, the screen of the main service of demonstration is called as " main screen ".
Term " picture in picture service " (PiP service) indication by the menu that shows on the physical display or by the user by remote controller via the selected service of the API of application program as the sub-services in the main service, can show on picture-in-picture screen (PiP screen) or main screen that PiP serves.
The PiP screen comprises the screen of the part that occupies another screen shown in Figure 1A to Fig. 1 D and the screen that does not show simultaneously with other screen overlays and another screen shown in Fig. 1 E to Fig. 1 F.In this case, should be appreciated that, the PiP screen can be included in the optional position in the physical display or the zone go up to show or with the screen of another screen overlay, shown in Fig. 1 G and Fig. 1 H.
Fig. 2 illustrates the diagrammatic sketch of the relation between the logical screen and display screen according to an exemplary embodiment of the present invention.
With reference to Fig. 2, can show service by using logical screen 210,212 and 214.Can logical screen 210,212 and 214 be mapped to display screen 220,222 and 224 by mapping block 230.
At length say, logical screen 210 and 212 is mapped to display screen 220, logical screen 212 and 214 is mapped to display screen 222, and logical screen 210,212 and 214 is mapped to display screen 224.
In brief, at least one logical screen that shows service is mapped to the arbitrary region of display screen.
With reference to Fig. 3 A, will comprise that with normal size the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain by mapper.Be mapped to the entire display screen curtain by mapper with the PiP screen that the big young pathbreaker who reduces includes only the video component.In this case, the PiP screen that on the main screen of determining according to the Z value, shows mapping.Reference character Z represents after a while with the z sequence valve of describing.Cover screen can make up with display screen.Cover screen is the specific screens of arranging in outermost, can use described cover screen when caption function is provided.As shown in Figure 3A, the PiP screen can only have the video component, and perhaps shown in Fig. 3 B, the PiP screen can have the combination of stationary background image B, video raster V and figure grating G.
With reference to Fig. 3 C, will comprise that with normal size the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain by mapper.Only have two PiP screen # 1 of video component and the arbitrary region that #2 is mapped to display screen by mapper with the big young pathbreaker who reduces.In this case, arrange the PiP screen of mapping on main screen, the Z value is by constant maintenance.In addition, cover screen can make up with display screen.The structure of screen can have a plurality of PiP screens that include only the video component shown in Fig. 3 C, or a plurality of PiP screens of the combination that comprises stationary background image B, video raster V and figure grating G shown in Fig. 3 D.
At picture out picture shown in Fig. 3 E (POP) screen.Be appreciated that the PiP screen that in main screen, shows prior art, and outside main screen, show the POP screen.With reference to Fig. 3 E, can comprise a plurality of PiP screen # 1 of combination of stationary background image B, video raster V and figure grating G and the arbitrary region that #2 is mapped to display screen with the big young pathbreaker who reduces by mapper.In this case, the Z value of the POP screen # 1 of mapping and #2 is by constant maintenance.In addition, cover screen can make up with display screen.
Can realize mapping block 230 by carrying out interface or the function prepared with multiple computer programming language, and by using above information to create as parameter or changing relation between logical screen and the display screen.
In addition, can realize mapping block 230 by hardware with the mapping function between logical screen and the display screen.
In addition, as shown in Figure 4, the service that provides by various services source can be provided on display screen, and can on physical display, show display screen.
There is following several services source: provide the service source of broadcast service, for example terrestrial broadcasting device 320 and wired broadcasting device 330; Provide the service source of the service of storing in the storage medium, for example personal video recorder (PVR) 340; With the service source (not shown among Fig. 4) that service is provided through cable network or wireless network.
Then, any service directly is set on display screen, on physical display, to show described any service by the method for using preordering method or user or application program setting.Otherwise, on physical display 350, show at least one logical screen that is mapped to the arbitrary region on the display screen.In brief, on physical display 350, show the service that terrestrial broadcasting device 320, wired broadcasting device 330 and PVR provide.
Shown in Fig. 5 A and Fig. 5 B, can be abstract service and non-abstract service with classification of service according to an exemplary embodiment of the present invention.
Abstract service is not the service that the broadcast singal by real-time transmission provides, but is independent of the service of broadcast channel.Abstract service includes only data component (that is, application program), and does not comprise video component and audio frequency component.The example of abstract service comprises based on the OCAP standard having the not service of binding application program.
Non-abstract service is understood that not to be the service of abstract service.
According to current exemplary embodiment of the present invention, abstract service and non-abstract service all have independence.For example, can abstract service directly be set on physical display, and can on logical screen, show non-abstract service by logical screen.Then, logical screen can be mapped to the display screen that is provided with abstract service.Can pass through physical display output display screen curtain thereafter.Thus, can be independent of non-abstract service and on display screen, show abstract service.In addition, abstract service can be mapped to different logical screens with non-abstract service.Logical screen can be mapped to single display screen thereafter.In other words, can be independent of non-abstract service and on display screen, show abstract service.
According to current exemplary embodiment of the present invention, logical screen and display screen can be categorized into different objects.Selectively, screen can be used as logical screen or display screen according to the attribute information of screen object.
Say that at length screen object is that logical screen or display screen are according to " Type " information in the screen object attribute.
The screen object attribute comprises " Type ", " z-Order ", " Display_Area ", " Visibility ", " Associated_Display_Screen ", " Associated_Service_Contexts " and " OutputPort ".
Fig. 6 illustrates the attribute information of screen object and is used to handle the interface of the attribute of screen.
Attribute " Type " 510 is used for determining the screen type of logical screen or display screen.
Attribute " z-Order " 520 is used for determining what order to arrange a plurality of logical screens along the z axle with.Fig. 7 illustrates the structure of logical screen on physical display of combination of the value of the attribute " z-Order " that is used for logical screen.
With reference to Fig. 7, respectively first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610.At length say, on display screen 610, show first logical screen 620, and on display screen 610, show second logical screen 630 with overlapping with first logical screen 620.In other words, on the direction of z axle, sequentially arrange display screen 610, first logical screen 620 and second logical screen 630.In this case, can be with attribute " z-Order " value of being set to 1 of first logical screen 620, can be with attribute " z-Order " value of being set to 2 of second logical screen 630.The attribute " z-Order " of first logical screen 620 and second logical screen 630 any numeral or character can be set to, the particular order of first logical screen 620 and second logical screen 630 will be arranged along the z axle as long as numeral or character can be expressed.
Attribute Display_Area " the 530th, about the information in the display screen zone of logical screen, will be shown in Fig. 8 A and Fig. 8 B.
Fig. 8 A illustrates the whole zone that logical screen 710 is mapped to display screen 720, and Fig. 8 B illustrates the subregion that logical screen 730 is mapped to display screen 740.
Attribute Display_Area " can comprise and be used to specify the information of logical screen the two-dimensional coordinate of the predetermined portions of the display screen that is mapped to, maybe can comprise how many information that is used to specify the precalculated position on the display screen and indication logical screens be offset from the described precalculated position on the display screen deviant.
Attribute " Visibility " 540 determines whether as seen the logical screen that to show on display screen.Can logical screen be appeared on the display screen or from display screen by the value that changes attribute " Visibility " 530 disappears.
Attribute " Associated_Display_Screen " the 550th is about the information of the display screen related with logical screen.Can not be displayed on the physical display with the uncorrelated logical screen of any display screen, and be not sent to outside output device.
Attribute " Associated_Service_Contexts " the 560th is about the information of the service context that is connected with logical screen or display screen.Can on logical screen or display screen, be presented at the service that is provided with in this service context.
Attribute " OutputPort " the 570th, about passing through its information with the device of output display screen curtain, this device comprises display screen, wire/wireless communication medium and multiple storage medium.
Can be provided for discerning or changing the interface of the value of the attribute shown in Fig. 6.With reference to Fig. 6, interface can comprise: interface " SET " sets property, or logical screen is connected to display screen; Interface " ADD " adds property value, or logical screen is connected to service; Interface " GET ", the recognition property value; And interface " REMOVE ", the delete property value.These interfaces can comprise processing, function, process or the method for the function of carrying out them respectively.
For example, method " getDisplayScreen (void) " is returned the display screen related with current screen.At length say, method getDisplayScreen (void) then if current screen is a logical screen " return related display screen.If current screen is a display screen, method getDisplayScreen (void) then " return reference information about current screen.In addition, if current screen is a logical screen, but do not have related screen, then method getDisplayScreen (void) " return value " NULL ".
According to another example, method " public void setDisplayArea (HScreenRectangle rect) throws SecurityExcption, IllegalStateException " is provided for current logical screen is mapped to the function of the presumptive area of related display screen.The example that being used as parameter provides is the class " HScreenRectangle " of bag " org.havi.ui ", and has two-dimensional position information.The execution of method " SecurityExcption " and " IllegalStateException " can be treated to the abnormal operation of method " SetOutputScreen (HScreenscreen) ".At current screen is logical screen or because the characteristic of host platform when causing changing the part of the display screen related with current logical screen, executing method " IllegalStateException ".
According to another example, method " getOutputArea (void) " is returned the area information of current screen as HSreenRectangle information.If current screen is corresponding to display screen, then method " getOutputArea (void) " is returned the HScreenRectangle information with value identical with HScreenRectangle (0,0,1,1).If current screen is a logical screen, then method " getOutputArea (void) " is returned the information that occupies the zone on the display screen about current screen.If current screen is a logical screen but not related with any display screen, then method " getOutputArea (void) " return value " NULL ".
Run through following description, use particular term to represent special interface.Yet a technical staff of this area will understand, specific function is simply named to indicate its function.The detailed description of exemplary embodiment is not intended to distinguish the title difference but the identical function of function.
Fig. 9 is illustrated in the diagrammatic sketch that the processing of two services is set with being mapped on two logical screens of single display screen.
With reference to Fig. 9, first service comprises three kinds of service components (that is, video component, audio frequency component and data component), and second service includes only video component and audio frequency component.Yet the present invention does not apply any restriction to the service groups branch, and the service of first shown in Fig. 9 and second service are exemplary.
As shown in Figure 9, with almost with prior art in identical mode show that on physical display first service and second serves.According to current exemplary embodiment of the present invention, the quantity that can be displayed on the service on the single display screen is not being applied under the situation of any restriction, can on physical display, show a plurality of services independently of each other.
Figure 10 is the block diagram that the equipment of multi-screen is provided according to an exemplary embodiment of the present invention.
With reference to Figure 10, be used to provide the equipment 900 of multi-screen to comprise: digital signal processing module 940, service processing module 950, output module 960 and user/application interface module 965.
In addition, equipment 900 comprises broadcast singal receiver module 910, storage medium 920 and outside input module 930 as the service source, and comprises that physical display 970, storage medium 980 and outside output module 990 are as the service output medium.
The meaning of term used herein " module " is, but is not limited to, and carries out the software or the nextport hardware component NextPort of particular task, such as field programmable gate array (FPGA) or application-specific integrated circuit (ASIC) (ASIC).Module can be configured to easily and reside on addressable storage medium, and can be configured on one or more processors and carry out.Therefore, for instance, module can comprise: such as assembly, process, function, attribute, process, subprogram, program code segments, driver, firmware, microcode, circuit, data, database, data structure, table, array and the variable of component software, OO component software, class component and task component.The function that provides in assembly and module can be combined into assembly and module still less, perhaps can further be separated into other assembly and module.
Digital signal processing module 940 receives the various information (for example, video information, audio-frequency information or data message) of service (for example, content of multimedia) from broadcast singal receiver module 910, storage medium 920 or outside input module 930.
Broadcast singal receiver module 910 receiving satellite broadcast signals, ground broadcast signal or cable broadcasting signal, and the broadcast singal of transmission reception, video information, audio-frequency information or the data message of storage medium 920 stores service, outside input module 930 receives video information, audio-frequency information or the data message of service from external device (ED) (for example, being connected to the network of network interface module).
Digital signal processing module 940 recovers a plurality of services by using the service component that receives.The service that recovers comprises abstract service or non-abstract service.
Here, phrase " a plurality of service " is meant two or more services that sent by broadcast singal receiver module 910, perhaps two or more services that sent by broadcast singal receiver module 910 and storage medium 920 respectively.
Digital signal processing module 940 can be according to the selection service of recovering by means of user/application interface module 965 of user or application program.In this case, user or application program can be selected the connection between any service and the screen.
Can can't help the service that service processing module 950 processing digital signal processing modules 940 recover.But, the service that digital signal processing module 940 recovers can be mapped directly to the specific part of the display screen that output module 960 produces.
The display screen that output module 960 provides can be displayed on the physical display 970, maybe can be stored in the storage medium 980.The example of storage medium 980 comprises computer-readable floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, BD (Blu-ray disc) and semiconductor memory.
In addition, can send to the external device (ED) that is connected with network through the display screen that outside output module 990 provides output module 960.
For this reason, output module 960 can comprise a plurality of output ports, can provide display screen through described a plurality of output ports.In this case, the output port of can output port or user through setting in advance to acquiescence selecting by means of user/application interface module 965 provides display screen.
The screen that is connected to the output port that output module 960 searches can be any one that carry out thereon in the logical screen of the application program that comprises in the respective service or the display screen that logical screen is mapped to.
In addition, the display screen that is connected to the output port that output module 960 searches can be thereon by the screen of mapping logic screen executive utility or thereon without the screen of the direct executive utility of mapping logic screen.
In addition, output module 960 can produce at least one output port about a screen, to shine upon with screen.In other words, user or application program can send to physical display 970, storage medium 980 or outside output module 990 with content displayed on the screen by user/application interface module 965.At this moment, output module 960 can produce separately and the corresponding output port in each path, and shines upon with corresponding screen.
In addition, output module 960 can change screen and be connected to annexation between the output port of described screen.For example, when first screen is mapped to first port, and second screen is when being mapped to second port, and output module 960 can be connected to second port with first screen based on the selection of user or application program, or second screen is connected to first port.
Can receive service more than one.In this case, service processing module 950 can produce a plurality of logical screens of the service that is used to present a plurality of receptions.That is, service processing module 950 can produce a plurality of logical screens that are respectively applied for the service that presents a plurality of receptions.
If service processing module 950 produces a plurality of logical screens, then output module 960 can be mapped to single output port with the logical screen combination that comprises at least one logical screen.That is, output module 960 can be mapped to one or more logical screens with single output port, selects described one or more logical screens from the logical screen that is produced by service processing module 950.
For this reason, output module 960 can be searched for the logical screen combination that will be connected to output port.More particularly, output module 960 can be searched for the logical screen combination that will be connected to output port by the screen attribute of reference output port and logical screen.The example of screen attribute comprises screen ratio and resolution.For example, if the screen ratio of output port is high definition (HD) grade, then output module 960 can be searched for the HD logical screen.On the other hand, if the screen ratio of output port is single-definition (SD) grade, then output module 960 can be searched for the SD logical screen.
User or application program can be selected one of a plurality of services by using user/application interface module 965, or recover the service of expectation.In addition, the user can select one of a plurality of display screens by using user/application interface module 965.
Because the module shown in Figure 10 is divided according to its function, so can be connected to other modules.
Figure 11 A illustrates the flow chart of the method for dynamic-configuration multi-screen according to an exemplary embodiment of the present invention.
Usually, send video information, audio-frequency information and the data message that constitutes content of multimedia with predetermined format (for example, mpeg stream form).At operation S1010, be used to provide equipment receiver, video information, audio-frequency information and the data message of service (for example, the content of multimedia service), and recover service based on video information, audio-frequency information and data message.Here, can select or pre-determine the service that recovers at operation S1010 by user or application program.The user can use the menu that shows on the display unit or remote controller to select connection between any screen and the screen.Application program can be selected described connection by using API.
In addition, data message comprises the application information about the application program that is used to serve, and this application information comprises signal message, and described signal message indicates whether to carry out described application program on the PiP screen.The example of application information comprises based on the application information table of MHP standard (AIT) with based on the extension application information table (XAIT) of OCAP standard.Can add signal message to application information.
The service that recovers, at operation S1020, the service of recovery is set, so that can be displayed on the logical screen thereafter.At operation S1030, logical screen is mapped to display screen.At operation S1040, provide display screen to the user by using display screen, storage medium or network.
Figure 11 B is the flow chart that is shown specifically search and changes the processing of output port.At operation S1050, output module 960 can be connected to the output port of display screen based on the control command search of user or application program.At operation S1060, output module 960 can change the output port that is connected to display screen based on the control command of user or application program.That is, when from user or application program input of control commands during with the search output port, output module 960 search are connected to the output port of current display screen.In addition, when from user or application program input of control commands when changing output port, the output port that output module 960 will be connected to current display screen is connected to another output port, to change annexation.
Figure 11 A and Figure 11 B illustrate through logical screen and show the service that recovers on physical display.Yet, can on physical display, directly not show the service that recovers by logical screen.
When the user selects the PiP service, under two kinds of patterns, realize the PiP service.Under first pattern, the independent logical screen of PiP service-creation (that is, the PiP screen under) the situation, only be not provided for the video component of the PiP service selected on the main screen.Under second pattern, to the independent logical screen of PiP service-creation, with the PiP service of selecting on the PiP screen that is provided at establishment.
Figure 11 A and Figure 11 B illustrate for the sake of simplicity only with the method for a map of services to display screen.Yet available a plurality of logical screens maybe need not arrive display screen with a plurality of map of services by a plurality of logical screens.
When by this way when the user provides display screen, the user can carry out a plurality of services.
Figure 12 is the diagrammatic sketch that the software architecture that multi-screen is provided according to an exemplary embodiment of the present invention is shown.
With reference to Figure 12, software architecture 1100 comprises device driver layer 1110, api layer 1120 and application layer 1130.
Device driver layer 1110 receives the service component from a plurality of content of multimedia source, and divides decoding to the service groups that receives.The example of the service component that receives comprises video information, audio-frequency information and data message.
Api layer 1120 produces logical screen and display screen, and service, logical screen and display screen are carried out mutual mapping.
Application layer 1130 provides user interface, so that the user dynamically disposes the logical screen that is used to show service, maybe order is sent to api layer 1120, so that api layer 1120 can be carried out described user command.
The user makes device driver layer 1110 display screen is provided or display screen is stored in the storage medium through physical display by means of application layer 1130.In addition, the user makes device driver layer 1110 display screen be sent to external device (ED) through network.
For this reason, device driver layer 1110 can comprise a plurality of output ports that display screen can be provided.Not so, api layer 1120 can comprise described a plurality of output port.
In order on display screen, dynamically to dispose a plurality of logical screens, api layer 1120 can comprise a plurality of software modules, for example, multi-screen manager module " MultiScreenManager " 1210, multi-screen context module " MultiScreenContext " 1230, multi-screen context monitor module " MultiScreenContextListener " 1250 and multi-screen context events module " MultiScreenContextEvent " 1240, as shown in figure 13.
When changing the attribute information of screen object 1220 by multi-screen context module 1230, multi-screen context events module 1240 usefulness act on the event class that changed of attribute information of announcement screen object 1220, multi-screen context monitor module 1250 is as the monitor interface object, described monitor interface object can be implemented in predetermined application class, and described predetermined application class attempts receiving the incident of being initiated by multi-screen context events module 1240.
At length say, application program 1260 will allow the various command of user's dynamic-configuration and management logic screen to send to multi-screen manager module 1210, and 1210 controls of multi-screen manager module are performed by multi-screen context module 1230 with the corresponding operation of described various command.
Figure 14 illustrates according to an exemplary embodiment of the present invention at the flow chart that shows a plurality of service method that show by module shown in Figure 13 on the display screen on each corresponding logical screen.
With reference to Figure 14, at operation S1310, multi-screen manager module 1210 produce display screens and with the corresponding a plurality of logical screens of the quantity of the service that will be performed.
At operation S1320, multi-screen manager module 1210 is connected to logical screen each the corresponding service that receives from device driver layer 1110.Multi-screen manager module 1210 can be set to be used for the parameter of logical screen service by the service context object that receives and come each logical screen call method " addServiceContexts ".Method " addServiceContexts " is connected to service with logical screen, and can provide described method " addServiceContexts " by multi-screen context module 1230.
At operation S1330, in case logical screen is connected to each service, multi-screen manager module 1210 just is connected to display screen with logical screen.At this moment, multi-screen manager module 1210 can be set to parameter and comes each logical screen call method " setDisplayScreen " by the display screen object that logical screen is connected to.Method " setDisplayScreen " is connected to display screen with logical screen, and can provide described method " setDisplayScreen " by multi-screen context module 1230.
Method " setDisplayScreen " can be set to " public void setDisplayScreen (HScreenscreen) throws Security Exception; Illegal StateException, and this method allows related with current screen as the example that provides as parameter " HScreen ".In this case, example " HScreen " is preferably display screen.
The parameter of method " setDisplayScreen (HScreen screen) " can comprise value " NULL ".In this case, when manner of execution under the situation that is not having abnormality processing " setDisplayScreen (HScreenscreen) ", current logical screen is no longer related with display screen.
The abnormal operation that the execution of method " SecurityException " and " IllegalStateException " can be used as method " setDisplayScreen (HScreen screen) " is carried out.
When current screen is logical screen or when the characteristic owing to host platform causes changing the part of the display screen related with current logical screen, executing method " IllegalStateException ".
At operation S1340, determine the zone on the display screen that logical screen will be mapped to respectively.At this moment, can call the preordering method that provides by multi-screen context module 1230, to determine with the zone on the display screen of display logic screen.
Figure 15 illustrates the state diagram of the operation of output module 960 according to an exemplary embodiment of the present invention.Output module 960 can be carried out output port search processing 1510 and output port changes processing 1520.
Handle 1510 in order to carry out the output port search, output module 960 can call method " getOutputPorts ".Using method " getOutputPorts " is extracted the video-out port that display screen is mapped to.The type of the data type of method " getOutputPorts " and the class of bag " org.ocap.hardware " " VideoOutputPort[] " is identical.That is, method " getOutputPorts " is returned the setting of the example " VideoOutputPort " that is connected to " HScreen ".
At this moment, have two kinds of display screens and be connected under the situation of video-out port at corresponding screen, method " getOutputPorts " is returned at least one example " VideoOutputPort ".Type at corresponding screen is that logical screen and logical screen are connected under the situation of display screen, and method " getOutputPorts " is returned the example " VideoOutputPort " that is connected to display screen.In addition, be that logical screen and logical screen are not connected under the situation of display screen in the type of corresponding screen, method " getOutputPorts " return value " NULL ".
Figure 16 A is the diagrammatic sketch that the example of the code that is used to search for the output port that is connected to screen is shown.In Figure 16, about screen object " screen " using method " getOutputPorts " of module " MultiScreenContext ".
Change processing 1520 in order to carry out output port, output module 960 can call method " addOutputPorts " or method " removeOutputPorts ".Using method " addOutputPorts " is added example " VideoOutputPort " to the setting of video-out port, described video-out port and screen mapping, and have parameter " VideoOutputPort " and a Boolean type sign " removeExisting ", wherein, when adding new output port, the screen of the removable previous mapping of described Boolean type sign " removeExisting ".
Can with " void addOutputPorts (and org.ocap.hardware.VideoOutputPort[] ports; Boolean removeExisting) throwsj ava.lang.SecurityException, java.lang.IllegalStateExcption " form come method for expressing " addOutputPorts ".
When the abnormality processing of processing method " addOutputPorts " does not have given predetermined right, but execute exception " java.lang.SecurityException ".When because hardware constraints when causing screen to be mapped to predetermined output port, when the example " VideoOutputPort " that can't change about screen (for example, when platform is connected to the predetermined set of example " VideoOutputPort " unchangeably), perhaps when predetermined instances " VideoOutputPort " has been connected to screen and Boolean type sign " removeExisting " and has not returned the true value, but execute exception " java.lang.IllegalStateExcption ".
Using method " removeOutputPorts " removes example " VideoOutputPort " from being mapped to corresponding screen and having being provided with of video-out port of parameter " VideoOutputPort ".
Can come method for expressing " removeOutputPorts " with the form of " void removeOutputPort (org.ocap.hardware.VideoOutputPort[] ports) throwsjava.lang.SecurityException; java.lang.IllegalStateExcption, java.lang.IllegalArgumentExcption ".
When the abnormality processing of processing method " removeOutputPorts " and when not having given predetermined right, but execute exception " java.lang.SecurityException ".Promptly, when the example " VideoOutputPort " that can't change about corresponding screen (for example, when platform is connected to the predetermined set of example " VideoOutputPort " unchangeably), can be when corresponding screen be not display screen execute exception " java.lang.IllegalStateException ".In addition, when predetermined instances " VideoOutputPort " when not being connected to corresponding screen, but execute exception " java.lang.IllegalStateException ".
Figure 16 B is the diagrammatic sketch that the example of the code that is used to change the output port that is connected to screen is shown.In Figure 16 B, about screen object " screen " using method " addOutputPorts " of module " MultiScreenConfigurableContext ".
Figure 17 illustrates the flow chart that will be displayed on the processing of the service on the logical screen by the exchange of the module shown in Figure 13.
In operation S1410, the service that the 1210 interim terminations of multi-screen manager module will exchange between two logical screens.
Thereafter, at operation S1420, exchange is about the information of described service between described two logical screens.At this moment, to each logical screen call method " removeServiceContexts " and the method " addServiceContexts " in described two logical screens, thereby exchanging the service context that in described two logical screens, is provided with between described two logical screens.Method " removeServiceContexts " removes the service context that is connected to logical screen, and method " addServiceContexts " is added new service context to logical screen.Can provide method " removeServiceContexts " and " addServiceContexts " by multi-screen context module 1230.According to current exemplary embodiment of the present invention, between logical screen, exchange information on services, thereby obtain the effect of exchange main screen and sub-screen about the service that is connected to logical screen.In addition, according to current exemplary embodiment of the present invention, even when on display screen, carrying out three or more services, also can between any a plurality of logical screens, exchange described service.
At operation S1430, the generation of the incident that the connection between the service of producing and two logical screens has changed.Thereafter, at operation S1440, multi-screen context events module 1240 sends to multi-screen context monitor module 1250 with described incident, and begins to carry out the service that newly is connected to two logical screens.
Utilizability on the industry
According to the present invention,, described multi-screen is connected to a plurality of ports that differ from one another for dynamic-configuration on the physics display screen provides the multi-screen of a plurality of contents.Therefore, the user can use described a plurality of screen according to purposes.
Although specifically illustrate and described the present invention with reference to exemplary embodiment of the present invention, but those of ordinary skill in the art should be understood that, under the situation of the spirit and scope of the present invention that do not break away from the claim qualification, can aspect form and details, carry out various changes.Therefore, should be understood that exemplary embodiment described above only for purpose of description is provided, and should not be interpreted as scope of the present invention is provided with restriction.
Claims (14)
1, a kind of equipment that multi-screen is provided, described equipment comprises:
Service processing module produces a plurality of logical screens that are used to show a plurality of services;
Output module will comprise that at least one the logical screen combination in described a plurality of logical screen is mapped to output port.
2, equipment as claimed in claim 1, wherein, output module is searched for the logical screen combination that can be mapped to output port in described a plurality of logical screens.
3, equipment as claimed in claim 2, wherein, output port comes the search logic screen combination by the screen attribute of reference output port and described a plurality of logical screens.
4, equipment as claimed in claim 3, wherein, the screen attribute comprises at least one in screen ratio and the resolution.
5, equipment as claimed in claim 1, wherein, the logical screen combination has the attribute identical with the attribute of the output screen that is connected to output port.
6, equipment as claimed in claim 5, wherein, service processing module is changed one of described a plurality of logical screens having the attribute identical with the attribute of output screen, and creates the logical screen combination of the logical screen that comprises conversion.
7, equipment as claimed in claim 1, wherein, output module makes up logical screen at least one output port that is mapped to except the current output port that is mapped to of logical screen combination.
8, a kind of method of dynamic-configuration multi-screen, described method comprises:
Generation is used to show a plurality of logical screens of a plurality of services;
To comprise that at least one the logical screen combination in described a plurality of logical screen is mapped to output port.
9, method as claimed in claim 8 also comprises: search can be mapped to the logical screen combination of output port in described a plurality of logical screens.
10, method as claimed in claim 9, wherein, described search comprises: come the search logic screen combination by the screen attribute of reference output port and described a plurality of logical screens.
11, method as claimed in claim 10, wherein, the screen attribute comprises at least one in screen ratio and the resolution.
12, method as claimed in claim 8, wherein, the logical screen combination has the attribute identical with the attribute of the output screen that is connected to output port.
13, method as claimed in claim 12 also comprises: change one of described a plurality of logical screens having the attribute identical with the attribute of output screen, and create the logical screen combination of the logical screen that comprises conversion.
14, method as claimed in claim 8 also comprises: logical screen is made up at least one output port that is mapped to except the current output port that is mapped to of logical screen combination.
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US78957706P | 2006-04-06 | 2006-04-06 | |
| US60/789,577 | 2006-04-06 | ||
| US60/812,090 | 2006-06-09 | ||
| US60/870,471 | 2006-12-18 | ||
| KR1020070024324 | 2007-03-13 | ||
| US60/918,894 | 2007-03-20 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101416496A true CN101416496A (en) | 2009-04-22 |
Family
ID=40595676
Family Applications (11)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Family Applications Before (6)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
Family Applications After (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Country Status (1)
| Country | Link |
|---|---|
| CN (11) | CN101416490A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102959981A (en) * | 2010-09-28 | 2013-03-06 | Lg电子株式会社 | Display device, display method, and multimedia transmission 10 method |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101763842B (en) * | 2009-11-13 | 2012-07-11 | 广东威创视讯科技股份有限公司 | Spliced wall body allocation system and position mapping method for establishing display units |
| CN103176684B (en) * | 2011-12-22 | 2016-09-07 | 中兴通讯股份有限公司 | A kind of method and device of multizone interface switching |
| US9632648B2 (en) | 2012-07-06 | 2017-04-25 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
| CN103631551A (en) * | 2012-08-27 | 2014-03-12 | 深圳市蓝韵网络有限公司 | Local display method for remote desktop in medical consultation system |
| KR102069547B1 (en) * | 2013-04-19 | 2020-01-28 | 삼성전자주식회사 | Method and apparatus for transmitting and receiving additional information in a broadcast communication system |
| US20180012570A1 (en) * | 2016-07-07 | 2018-01-11 | Futurewei Technologies, Inc. | Apparatus and method for mapping frame buffers to logical displays |
| CN111045622B (en) * | 2019-11-21 | 2023-06-30 | 中国航空工业集团公司西安航空计算技术研究所 | Object-oriented display control interface model |
-
2007
- 2007-04-04 CN CNA2007800120942A patent/CN101416490A/en active Pending
- 2007-04-05 CN CNA2007800120143A patent/CN101416487A/en active Pending
- 2007-04-05 CN CNA2007800120213A patent/CN101416488A/en active Pending
- 2007-04-05 CN CNA2007800121837A patent/CN101416492A/en active Pending
- 2007-04-05 CN CNA2007800120317A patent/CN101416489A/en active Pending
- 2007-04-05 CN CNA2007800122149A patent/CN101416494A/en active Pending
- 2007-04-05 CN CNA2007800124017A patent/CN101416496A/en active Pending
- 2007-04-05 CN CNA2007800124144A patent/CN101416497A/en active Pending
- 2007-04-05 CN CNA2007800121926A patent/CN101416493A/en active Pending
- 2007-04-05 CN CNA2007800123118A patent/CN101416495A/en active Pending
- 2007-04-05 CN CNA2007800121146A patent/CN101416491A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102959981A (en) * | 2010-09-28 | 2013-03-06 | Lg电子株式会社 | Display device, display method, and multimedia transmission 10 method |
| US9131268B2 (en) | 2010-09-28 | 2015-09-08 | Lg Electronics Inc. | Display device, display method, and multimedia transmission method |
| CN102959981B (en) * | 2010-09-28 | 2016-05-18 | Lg电子株式会社 | Display device, display methods |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101416491A (en) | 2009-04-22 |
| CN101416489A (en) | 2009-04-22 |
| CN101416497A (en) | 2009-04-22 |
| CN101416487A (en) | 2009-04-22 |
| CN101416493A (en) | 2009-04-22 |
| CN101416492A (en) | 2009-04-22 |
| CN101416495A (en) | 2009-04-22 |
| CN101416488A (en) | 2009-04-22 |
| CN101416490A (en) | 2009-04-22 |
| CN101416494A (en) | 2009-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101238724B (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| CN101416496A (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| KR20080030976A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| MX2008012822A (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens. | |
| KR100791302B1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR100888595B1 (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR20070100111A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| KR20070017011A (en) | Apparatus for providing multiple screens and method for dynamic configuration of the same | |
| WO2007114659A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |