CN101416495A - Apparatus for providing multiple screens and method of dynamically configuring multiple screens - Google Patents

Apparatus for providing multiple screens and method of dynamically configuring multiple screens Download PDF

Info

Publication number
CN101416495A
CN101416495A CNA2007800123118A CN200780012311A CN101416495A CN 101416495 A CN101416495 A CN 101416495A CN A2007800123118 A CNA2007800123118 A CN A2007800123118A CN 200780012311 A CN200780012311 A CN 200780012311A CN 101416495 A CN101416495 A CN 101416495A
Authority
CN
China
Prior art keywords
screen
logical
service
output
screens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007800123118A
Other languages
Chinese (zh)
Inventor
李钟昊
李光基
边成昱
格伦·A·亚当斯
郑云教
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN101416495A publication Critical patent/CN101416495A/en
Pending legal-status Critical Current

Links

Images

Abstract

An apparatus for providing multiple screens and a method of dynamically configuring multiple screens is provided. The apparatus for providing multiple screens is capable of connecting a plurality of screens to a plurality of output ports so as to dynamically configure the plurality of screens which provide multiple contents on a single physical display device. The apparatus for providing multiple screens includes a service processing module which generates an output screen and a plurality of logical screens for displaying a plurality of services, and an output module which searches the plurality of logical screens for a logical screen combination that can be connected to an output port and that is mapped to the output screen, and maps the output screen to the output port.

Description

The equipment of a plurality of screens is provided and dynamically disposes the method for a plurality of screens
Technical field
Equipment consistent with the present invention and method relate to be provided and a plurality of screens of dynamic-configuration, more particularly, relates to a plurality of screens are connected to a plurality of output ports, and a plurality of screens of a plurality of contents are provided on the single physical display unit with dynamic-configuration.
Background technology
The radio receiver of prior art (such as Digital Television (TV) or top box of digital machine) is only providing a content element or showing main screen and sub-screen simultaneously on the single physical display unit on the single physical display unit.
Even the prior art radio receiver can show main screen and sub-screen simultaneously on identical display screen, the prior art radio receiver also only can be arranged main screen and sub-screen with limited mode.In main screen under the situation of displaying contents, all elements of displaying contents (that is, video data, voice data and other data).On the other hand, in sub-screen under the situation of displaying contents, the part element of displaying contents only.
Content source comprises broadcast service (such as satellite broadcasting device, terrestrial broadcasting device or wired broadcasting device), storage medium (such as digital versatile disc (DVD) or be connected to the external device (ED) of input).Yet, be difficult to use existing radio receiver on display screen, to show the content that so various content source provide.
In interactive TV application environment (such as multimedia home platform (MHP), senior common application platform (ACAP) and open cable application platform (OCAP)), suppose on physical display, only to export a screen.
In interactive TV application environment, for example adopt home audio/video interoperability (HAVi) based on user interface (UI).According to the HAViUI standard,, on physical display, also only show a screen usually even without the quantity that is presented at the screen on the physical display is applied restriction.
Summary of the invention
Technical problem
In this environment, the executable operations (such as decoding, Digital Signal Processing, user interaction process etc.) in the content of multimedia that shows on being difficult on independent screen to show in the content of multimedia screen.In addition, also be difficult to the use of resource in the life cycle of controlling application program dynamically and the screen unit.
Therefore, need a kind of method that on the screen of dynamic-configuration, shows various contents.
Technical scheme
The invention provides a kind of dynamic-configuration provides a plurality of screens of a plurality of contents on physical display equipment and method that be used for.
According to an aspect of the present invention, provide a kind of equipment that is used to provide a plurality of screens.Described equipment comprises: service processing module produces an output screen and a plurality of logical screens that are used to show a plurality of services; Output module is searched for the logical screen combination that can be connected to output port and be mapped to described output screen in described a plurality of logical screens, and described output screen is mapped to output port.
The method of a plurality of screens of a kind of dynamic-configuration is provided according to a further aspect in the invention.Described method comprises: produce an output screen and a plurality of logical screens that are used to show a plurality of services; In described a plurality of logical screens, search for the logical screen combination that can be connected to output port and be mapped to described output screen; Described output screen is mapped to output port.
Description of drawings
The detailed description that exemplary embodiment of the present invention is carried out in conjunction with the drawings, above-mentioned and others of the present invention will become apparent, wherein:
Figure 1A to Fig. 1 H is the diagrammatic sketch that illustrates according to the configuration of the PiP screen of exemplary embodiment of the present invention;
Fig. 2 illustrates according to the logical screen of exemplary embodiment of the present invention and the diagrammatic sketch of the relation between the display screen;
Fig. 3 A to Fig. 3 E is the diagrammatic sketch that illustrates according to the configuration of the screen that comprises mapper of exemplary embodiment of the present invention;
Fig. 4 is the block diagram that illustrates according to the service source of exemplary embodiment of the present invention;
Fig. 5 A and Fig. 5 B illustrate according to the non-abstract service of exemplary embodiment of the present invention and the diagrammatic sketch of abstract service;
Fig. 6 illustrates the attribute information of logical screen and display screen and the diagrammatic sketch at interface;
Fig. 7 is the diagrammatic sketch that illustrates according to the attribute " z-order " of the logical screen of exemplary embodiment of the present invention;
Fig. 8 A and Fig. 8 B are that each all illustrates the diagrammatic sketch according to the attribute " Display_Area " of the logical screen of exemplary embodiment of the present invention;
Fig. 9 is the diagrammatic sketch that illustrates according to the method for display screen that two map of services are arrived of exemplary embodiment of the present invention;
Figure 10 is the block diagram of configuration of equipment that is used to provide a plurality of screens that illustrates according to exemplary embodiment of the present invention;
Figure 11 A and Figure 11 B are the flow charts that illustrates according to the method for a plurality of screens of dynamic-configuration of exemplary embodiment of the present invention;
Figure 12 is the diagrammatic sketch of software architecture that is used to provide a plurality of screens that illustrates according to exemplary embodiment of the present invention;
Figure 13 is the diagrammatic sketch that illustrates according to the relation between the module of the composition application programming interfaces (API) of exemplary embodiment of the present invention layer;
Figure 14 is module shown in Figure 13 shows the processing of a plurality of services on display screen by logical screen the flow chart that passes through that illustrates according to exemplary embodiment of the present invention;
Figure 15 is the state diagram that illustrates according to the operation of the output module of exemplary embodiment of the present invention;
Figure 16 A and Figure 16 B are the diagrammatic sketch of example that is used to search for and change the code of output port that illustrates according to exemplary embodiment of the present invention; And
Figure 17 is the flow chart that module shown in Figure 13 changes the processing of a plurality of services that show on the logical screen that passes through that illustrates according to exemplary embodiment of the present invention.
Embodiment
By with reference to following the detailed description and the accompanying drawings to exemplary embodiment, advantage of the present invention and characteristics and realize that the method for described advantage and characteristics can easily be understood.Yet the present invention can be implemented with various forms, and should not be interpreted as showing exemplary embodiment set forth herein.On the contrary, thereby provide these embodiment disclosure will be thoroughly and complete and fully design of the present invention is conveyed to those skilled in the art, the present invention will be limited by claim.In whole accompanying drawing, identical label is meant identical parts.
Below, with reference to describing the present invention according to the user interface of exemplary embodiment of the present invention, the flow chart of method and computer program product.Should be appreciated that each piece of flow chart and the combination of the piece in flow chart can be realized by computer program instructions.These computer program instructions can be provided for the processor of all-purpose computer, special-purpose computer or other programmable data processing device with generation equipment, thereby create the device that is used for being implemented in the function that a flow chart block or a plurality of flow chart block describe via the instruction that the processor of computer or other programmable data processing device is carried out.
These computer program instructions also can be stored in bootable computer or other programmable data processing device with the computer of ad hoc fashion operation can with or computer-readable memory in, thereby be stored in computer can with or computer-readable memory in instruction generate the product that comprises execution command device of the function of appointment in a flow chart block or a plurality of flow chart block.
Computer program instructions also can be written into computer or other programmable data processing device, so that the sequence of operations step is performed the processing of carrying out with the generation computer on computer or other programmable devices, thereby the instruction of carrying out on computer or other programmable devices is provided for being implemented in the step of the function of describing in a flow chart block or a plurality of flow chart block.
Can represent module, code segment or code section for every of flow chart, it comprises one or more executable instructions that are used to realize specific logic function.It should be noted that in the realization of some replacements, the function that marks can not carried out in order in these pieces.For example, two pieces that illustrate continuously in fact can substantially side by side be performed, and perhaps sometimes with opposite order execution block, this depends on the function that relates to.
In order to understand the present invention better, now be defined in the term that uses in the disclosure.
One group of content of multimedia that term " service " indication shows together, i.e. one group of service component (component).
Service component is the element of service, comprises video component, audio component and data component.Data component is the application in the service.
In addition, application class is not used for binding the application and service binding.Because binding is used and to be had high priority, therefore Resources allocation reposefully.Monitoring is used and is used corresponding with the specific not binding with limit priority.
Service binding is used relevant with transport stream, and allows than not binding the low priority of using of priority.Service binding is used not as critical system.When resource contention occurring, service binding is used than not binding and is used the probability with bigger relinquishes resources.Service binding is used and is comprised bond type and non-binding type, and described bond type is operated in combination with the stream that is transmitting, and described non-binding type depends on and flows to line operate.
The various resources, device and the execution state information that provide service required are provided the object of the execution of term " service context (context) " indication control service.
The physical space of the content of term " physical display " indication actual displayed service.
The screen of term " display screen " indication actual displayed on physical display.Any service can directly be set, and display screen can be displayed on the physical display on display screen.Perhaps, at least one logical screen that is mapped to the specific region of display screen can be displayed on the physical display.
Term " logical screen " indicated number is the space of service arbitrarily.Logical screen is to be mapped to display screen virtual screen before, therefore is not displayed on the physical display.
Logical screen and display screen can be the combinations of stationary background image, video raster and figure grating.The figure grating can be the combination of text, line, color and image or mixing of frame of video.
Term " main service " menu or the remote controller of indication user by showing on the physical display perhaps used the selected service as main service by API, and shown that the screen of main service is called as " main screen ".
Menu or the selected service as the sub-services in the main service of remote controller by showing on the physical display via API or user used in term " picture in picture service (PiP service) " indication, and the PiP service can be displayed on picture-in-picture screen (PiP screen) or the main screen.
The PiP screen comprise the screen of the part that occupies another screen shown in Figure 1A to Fig. 1 D and shown in Fig. 1 E to Fig. 1 F, show simultaneously with another screen and not with the screen of other screen overlay.In this case, be appreciated that the PiP screen can comprise that the optional position that is presented in the physical display or zone are gone up or with the screen of another screen overlay, shown in Fig. 1 G and 1H.
Fig. 2 illustrates according to the logical screen of exemplary embodiment of the present invention and the diagrammatic sketch of the relation between the display screen.
With reference to Fig. 2, can use logical screen 210,212 and 214 to realize service.Logical screen 210,212 and 214 is mapped to display screen 220,222 and 224 by mapping block 230.
At length, logical screen 210 and 212 is mapped to display screen 220, and logical screen 212 and 214 is mapped to display screen 222, and logical screen 210,212 and 214 is mapped to display screen 224.
Briefly, show that at least one logical screen of service is mapped to the arbitrary region of display screen.
Mapping block 230 is the groups that logical screen are mapped to the required various information of display screen.The example of described various information comprises the identifying information of coordinate information, logical screen and display screen of the presumptive area on each display screens that is mapped to of a plurality of logical screens and the information of specifying logical screen to show in proper order with which kind of on display screen.
Mapping block 230 can change the size of logical screen to be assigned to the arbitrary region of display screen.That is to say, but the distribution of the position of the convergent-divergent of mapping block 230 actuating logic screens and logical screen, and Fig. 3 A to Fig. 3 E illustrates the diagrammatic sketch that comprises as the configuration of the screen of the mapper of mapping block.
With reference to Fig. 3 A, will comprise that by mapper the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain with common size.The PiP screen that will only comprise video component by mapper is mapped to the entire display screen curtain with the size that reduces.In this case, on main screen, described main screen comes definite according to Z value with the PiP screen display of mapping.Reference character Z is meant after a while with the z-order value of describing.Overlapping screen can merge with display screen.Overlapping screen is to be arranged in outermost specific screens, and can use overlapping screen when caption function is provided.The PiP screen can only have video component (as shown in Figure 3A), perhaps can have the combination (shown in Fig. 3 B) of stationary background image B, video raster V and figure grating G.
With reference to Fig. 3 C, will comprise that by mapper the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain with common size.To only comprise the PiP screen #1 of video component and PiP screen #2 is mapped to display screen with the size that reduces arbitrary region by mapper.In this case, the PiP screen of mapping is disposed on the main screen, and the Z value can be invariable.In addition, overlapping screen can merge with display screen.The configuration of screen can have a plurality of PiP screens (shown in Fig. 3 C) that only comprise video component, perhaps can have a plurality of PiP screens (shown in Fig. 3 D) of the combination that comprises stationary background image B, video raster V and figure grating G.
Fig. 3 E illustrates picture out picture (POP) screen.Be appreciated that prior art PiP screen display in the inside of main screen, the POP screen display is in the outside of main screen.With reference to Fig. 3 E, will comprise that by mapper a plurality of PiP screens (PiP screen #1 and PiP screen #2) of the combination of stationary background image B, video raster V and figure grating G are mapped to the arbitrary region of display screen with the size that reduces.In this case, the Z value of the POP screen #1 of mapping and POP screen #2 can be invariable.In addition, overlapping screen can merge with display screen.
Interface or the function prepared by the various computer programming languages that will be performed realize mapping block 230, and mapping block 230 is by using above-mentioned information and create as parameter or changing relation between logical screen and the display screen.
In addition, can realize mapping block 230 by the hardware that between logical screen and display screen, has mapping function.
In addition, can on display screen, show the service that various services source provides, and can on physical display, show described display screen, as shown in Figure 4.
There is service source (such as terrestrial broadcasting device 320 and wired broadcasting device 330) that broadcast service is provided, service source that is stored in the service in the storage medium (such as personal video recorder (PVR) 340) and the service source (not having shown in Figure 4) that service is provided via cable network or wireless network are provided.
Radio receiver 310 receives service from the service source, and produces the logical screen of the service that is used to show each reception.
Then, use preordering method or by the user or use the method that is provided with any service directly is set on the display screen that will be presented on the physical display.Otherwise, on physical display 350, show at least one logical screen that is mapped to the arbitrary region on the display screen.Briefly, on physical display 350, show the service that terrestrial broadcasting device 320, wired broadcasting device 330 and PVR provide.
Fig. 4 illustrates terrestrial broadcasting device 320, wired broadcasting device 330 and PVR 340 as the service source, but the invention is not restricted to this.According to exemplary embodiment of the present invention, the content of multimedia source that any kind of the content of multimedia that can show together is provided can be the service source.
Service according to exemplary embodiment of the present invention can be classified as abstract service and non-abstract service, shown in Fig. 5 A and Fig. 5 B.
Abstract service is not the service that the broadcast singal of transmission in real time provides, but is independent of the service of broadcast channel.Abstract service only comprises data component (promptly using) and does not comprise video component and audio component.The example of abstract service comprises the service that not binding is used that has based on the OCAP standard.
Non-abstract service is understood that the service except abstract service.
According to current exemplary embodiment of the present invention, abstract service and non-abstract service have independence.For example, can abstract service directly be set on physical display, and can on logical screen, show non-abstract service by logical screen.Then, logical screen can be mapped to the display screen that is provided with abstract service.Can pass through physical display output display screen curtain thereafter.Like this, can be independent of non-abstract service and on display screen, show abstract service.In addition, abstract service can be mapped to different logical screens with non-abstract service.Logical screen can be mapped to single display screen thereafter.In other words, can be independent of non-abstract service and on display screen, show abstract service.
According to current exemplary embodiment of the present invention, logical screen can be classified as different objects with display screen.Perhaps, screen can be used as logical screen or display screen according to the attribute information of a screen object.
At length, screen object is that logical screen or display screen depend on " type " information among the screen object attribute.
The screen object attribute comprises: " Type ", " z-Order ", " Display_Area ", " Visibility ", " Associated_Display_Screen ", " Associated_Service_Contexts " and " OutputPort ".
Fig. 6 illustrates the attribute information of screen object and is used to handle the interface of the attribute of screen.
Attribute " Type " 510 is used for determining that screen type is logical screen or display screen.
Attribute " z-Order " 520 be used for determining a plurality of logical screens along the z axle with which kind of sequence arrangement.Fig. 7 illustrates the configuration of the logical screen on the physical display in conjunction with the value of the attribute " z-Order " of logical screen.
With reference to Fig. 7, first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610 respectively.At length, first logical screen 620 is presented on the display screen 610, and second logical screen 630 and first logical screen 620 are presented on the display screen 610 with overlapping.In other words, the direction along the z axle is arranged in order display screen 610, first logical screen 620 and second logical screen 630.In this case, the attribute " z-Order " that the attribute of first logical screen 620 " z-Order " can the value of being set to 1, the second logical screen 630 can the value of being set to 2.The attribute " z-Order " of first logical screen 620 and second logical screen 630 can be set to any numeral or character, as long as they can represent the particular order that first logical screen 620 and second logical screen 630 are arranged along the z axle.
Attribute " Display_Area " the 530th is about the information in the display screen zone of logical screen, shown in Fig. 8 A and Fig. 8 B.
Fig. 8 A illustrates the whole zone that logical screen 710 is mapped to display screen 720, and Fig. 8 B illustrates the subregion that logical screen 730 is mapped to display screen 740.
Attribute " Display_Area " can comprise the information of the two-dimensional coordinate of the predetermined portions of specifying the display screen that logical screen is mapped to, and can comprise that perhaps the information of specifying the precalculated position on the display screen and indication logical screen depart from what the deviant of precalculated position on the display screen.
Attribute " Visibility " 540 determines that logical screen shows still demonstration invisibly visibly on display screen.Can logical screen be occurred on display screen by the value that changes " Visibility " 540 or disappear from display screen.
Attribute " Associated_Display_Screen " the 550th is about the information of the display screen relevant with logical screen.The logical screen that all has nothing to do with any display screen can not be presented on the physical display or not be sent to outside output device.
Attribute " Associated_Service_Contexts " the 560th is about the information of the service context that is connected to logical screen or display screen.The service that is provided with in this service context can be displayed on logical screen or the display screen.
Attribute " OutputPort " the 570th, about the information of the device of output display screen curtain, this device comprises display screen, wire/wireless communication medium and various storage medium.
Can be provided for discerning or changing the interface of the value of the attribute shown in Fig. 6.With reference to Fig. 6, interface can comprise: be used to set property or with logical screen be connected to display screen interface " SET ", be used to add property value or with logical screen be connected to service interface " ADD ", be used for the interface " GET " of recognition property value and be used for the interface " REMOVE " of delete property value.These interfaces can comprise processing, function, program or the method for the function of carrying out them respectively.
For example, method " getDisplayScreen (void) " is returned the display screen relevant with current screen.At length, if current screen is a logical screen, then method " getDisplayScreen (void) " is returned relevant display screen.If current screen is a display screen, then method " getDisplayScreen (void) " is returned the reference information about current screen.In addition, if current screen is a logical screen, but there are not screen associated, then method " getDisplayScreen (void) " return value " NULL ".
According to another example, method " public void setDisplay Area (HScreenRectangle rect) throws SecurityException, IllegalStateException " is provided for current logical screen is mapped to the function of the presumptive area of relevant display screen.The example that is provided as parameter is the class " HScreenRectangle " of bag " org.havi.ui ", and has two-dimensional position information.The execution of method " SecurityException " and " IllegalStateException " can be used as the abnormal operation of method " setOutputScreen (HScreen screen) " and carries out.When current screen is logical screen or in the part of the display screen relevant with current logical screen because the characteristic of host platform can not change the time, executing method " IllegalStateException ".
According to another example, method " getOutputArea (void) " is returned the area information of current screen as HScreenRectangle information.If current screen and display screen are corresponding, then method " getOutputArea (void) " is returned the HScreenRectangle information with value identical with HScreenRectangle (0,0,1,1).If current screen is a logical screen, then method " getOutputArea (void) " is returned the information in the zone on the display screen that occupies about current screen.If current screen is a logical screen, but not relevant with any display screen, method " getOutputArea (void) " return value " NULL " then.
The particular term of Shi Yonging is meant special interface in the following description.Yet, it should be appreciated by those skilled in the art that specific function is named and only be used to indicate it functional.This detailed description of exemplary embodiment is not to want distinguishing function nominally, but distinguishes on function.
Fig. 9 is illustrated in the diagrammatic sketch that the processing of two services is set with being mapped on two logical screens of single display screen.
With reference to Fig. 9, first service comprises all three service component (being video component, audio component and data component), and second service only comprises video component and audio component.Yet the present invention does not apply any restriction to service component, and the service of first shown in Fig. 9 and second service are exemplary.
As shown in Figure 9, on physical display, to show first service and second service with prior art mode much at one.According to current exemplary embodiment of the present invention, can on physical display, show a plurality of services independently of one another, and the quantity that can be presented at the service on the single display screen not applied any restriction.
Figure 10 is the block diagram of equipment that is used to provide a plurality of screens according to exemplary embodiment of the present invention.
With reference to Figure 10, be used to provide the equipment 900 of a plurality of screens to comprise digital signal processing module 940, service processing module 950, output module 960 and user/AIM 965.
In addition, equipment 900 comprises broadcast singal receiver module 910, storage medium 920 and the outside input module 930 as the service source, and comprises physical display 970, storage medium 980 and outside output module 990 as the service output medium.
Use the meaning of term " module " to be at this, but be not limited to, realize the software and hardware assembly of particular task, such as field programmable gate array (FPGA) or application-specific integrated circuit (ASIC) (ASIC).Module can be configured to easily and reside on addressable storage medium, and can be configured on one or more processors and carry out.Therefore, for instance, module can comprise: such as assembly, process, function, attribute, process, subprogram, program code segments, driver, firmware, microcode, circuit, data, database, data structure, table, array and the variable of component software, OO component software, class component and task component.The function that provides in assembly and module can be combined into assembly and module still less, perhaps can further be separated into other assembly and module.
The various information that digital signal processing module 940 receives such as the service of content of multimedia from broadcast singal receiver module 910, storage medium 920 and outside input module 930, for example, video information, audio-frequency information or data message.
Broadcast singal receiver module 91 receiving satellite broadcast signals, ground broadcast signal or cable broadcasting signal also send the broadcast singal that receives, video information, audio-frequency information or the data message of storage medium 920 stores service, outside input module 930 receive video information, audio-frequency information or the data message of service from external device (ED) (such as being connected to the network of network interface arrangement).
Digital signal processing module 940 uses the service component that receives to recover a plurality of services.The service that recovers comprises abstract service or non-abstract service.
Here, phrase " a plurality of service " is meant two or more services that broadcast singal receiver module 910 sends, perhaps two or more services of sending respectively of broadcast singal receiver module 910 and storage medium 920.
Digital signal processing module 940 can the selection according to user or application recover service under the help of user/AIM 965.In this case, user or application can be selected the connection between service arbitrarily and the screen.
Service processing module 950 produces one or more logical screens and the service of display screen to show that digital signal processing module 940 recovers.
Output module 960 is mapped to display screen with a plurality of logical screens that service processing module 950 produces.The method that can use predefined method or user to be provided with under the help of user/AIM 965 is carried out the mapping of logical screen to display screen.
Can only handle the service that recovers by digital signal processing module 940 by service processing module 950.Replace, the service that digital signal processing module 940 recovers can be mapped directly to the specific part of the display screen of output module 960 generations.
The display screen that output module 960 provides can be presented on the physical display 970, perhaps is stored in the storage medium 980.The example of storage medium 980 comprises computer-readable floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, BD (Blu-ray disc) and semiconductor memory.
In addition, the display screen that output module 960 provides can be sent to the external device (ED) that is connected to network via outside output module 990.
For this reason, output module 990 can comprise a plurality of output ports, can provide display screen via described output port.In this case, can provide display screen via the output port or the output port under the help of user/AIM 965, selected of user that set in advance to acquiescence.
Output module 960 can be searched for the output port that is connected to screen.That is to say that output module 960 search in the screen that service processing module 950 produces connects the output port of predetermined screen.
The screen that is connected to the output of output module 960 search can be to carry out any one that is included in the logical screen of the application in the respective service or the display screen that logical screen is mapped to.
In addition, the screen that is connected to the output of output module 960 search can be to carry out the screen of using by the mapping logic screen, perhaps can be mapping logic screen and directly carry out the screen of using not.
In addition, output module 960 can produce at least one output port for a screen, to shine upon with described screen.In other words, user or application can send to physical display 970, storage medium 980 or outside output module 990 by the content that user/AIM 965 will be presented on the screen.At this moment, output module 960 can produce separately corresponding to each path of corresponding screen and the output port of mapping.
In addition, output module 960 can change screen and be connected to annexation between the output port of screen.For example, when first screen is mapped to first port, when second screen was mapped to second port, output module 960 can be connected to first screen second port or second screen is connected to first port based on the selection of user or application.
Can receive a plurality of services.In this case, service processing module 950 can produce a plurality of logical screens of the service that is used to represent a plurality of receptions.That is to say that service processing module 950 produces a plurality of logical screens of the service that is used to represent a plurality of receptions respectively.
If service processing module 950 produces a plurality of logical screens, then output module 960 can be searched for the logical screen that can be connected to output port from logical screen, and the output screen that the logical screen combination of discerning is mapped to is mapped to output port.That is to say that output module 960 can be mapped to single output screen with one or more logical screens of selecting the logical screen that produces from service processing module 950, and the output screen that comprises the logical screen of selection can be mapped to single output port.
The screen attribute that output module 960 can be by the reference logical screen and the logical attribute search of output port can be connected to the logical screen of output port.The example of screen attribute comprises screen ratio and resolution.For example, if the screen ratio of output port is high definition (HD) grade, then output module 960 can be searched for the HD logical screen.On the other hand, if the screen ratio of output port is single-definition (SD) grade, then output module 960 can be searched for the SD logical screen.
Output module 960 can be mapped to one or more output ports with the logical screen combination that is mapped to an output port.Therefore, comprise that the logical screen combination of one or more logical screens can be formed screen, and can be via a plurality of output port output screens.
The service that user or application can use user/AIM 965 to select in a plurality of services or recover to expect.In addition, the user can use user/AIM 965 to select in a plurality of display screens one.
Because the module shown in Figure 10 is divided according to their function, therefore can be connected to other module.
Figure 11 A is the flow chart that illustrates according to the method for a plurality of screens of dynamic-configuration of exemplary embodiment of the present invention.
Usually, video information, audio-frequency information and the data message of composition content of multimedia are sent out with predetermined format (for example, mpeg stream form).At operation S1010, be used to provide equipment receiver, video information, audio-frequency information and the data message of service (such as the content of multimedia service), and recover service based on video information, audio-frequency information and data message.Here, can or pre-determine the service that recovers at operation S1010 by user or application choice.The user can use at the menu that shows on the display unit or remote controller and select connection between any screen and the screen.Application can use API to select to connect.
In addition, data message comprises the application message about the application that is used to serve, and this application message comprises the signal message whether the indication application can be carried out on the PiP screen.The example of application message comprises based on the application information table of MHP standard (AIT) with based on the expanded application information table (XAIT) of OCAP standard.Can add signal message to application message.
Below, at operation S1020, thereby the service that recovery is set can be presented at it on logical screen.At operation S1030, logical screen is mapped to display screen.At operation S1040, display screen is offered user, storage medium or the network that uses display screen.
Figure 11 B is the flow chart that the output search is shown and changes the processing of output port.At operation S1050, output module 960 can be based on the output port that is connected to display screen from the control command search of user or application.At operation S1060, output module 960 can change the output port that is connected to display screen based on the control command from user or application.That is to say that when from the user or when using input of control commands with the search output port, output module 960 search are connected to the output port of current display screen.In addition, when from the user or use input of control commands when changing output port, the output port that output module 960 will be connected to current display screen is connected to another output port, to change annexation.
Service in the recovery that shows on physical display via logical screen shown in Figure 11 A and the 11B.Yet, the service of the recovery that can be not directly on physical display, show by logical screen.
When the user selects the PiP service, realize the PiP service with two kinds of patterns.In first kind of pattern, only there is the video component of serving to be provided, and is not the independent logical screen of PiP service-creation from the PiP of main screen selection, that is, and the PiP screen.Under second kind of pattern, create the independent logical screen that is used for the PiP service, on the PiP screen of creating so that the PiP service of selection to be provided.
For simply, Figure 11 A and 11B illustrate only with the method for a map of services to display screen.Yet, can by a plurality of logical screens or not by a plurality of logical screens with a plurality of map of services to display screen.
When by this way display screen being offered the user, the user can carry out a plurality of services.
Figure 12 is the diagrammatic sketch of software architecture that is used to provide a plurality of screens that illustrates according to exemplary embodiment of the present invention.
With reference to Figure 12, software architecture 1100 comprises device Drive Layer 1110, api layer 1120 and application layer 1130.
Device Drive Layer 1110 receives service component from various content of multimedia source, and the service component that receives is decoded.The example of the service component that receives comprises video information, audio-frequency information and data message.
Api layer 1120 produces logical screen and display screen, and service, logical screen and display screen are shone upon each other.
Application layer 1130 provides user interface, thus the user can dynamic-configuration show service or user command sent to the logical screen of api layer, thereby api layer 1120 can be carried out user command.
The user makes device Drive Layer 1110 provide display screen via physical display under the help of application layer 1130, perhaps display screen is stored in the storage medium.In addition, the user can make device Drive Layer 1110 via network display screen be sent to external device (ED).
For this reason, device Drive Layer 1110 can comprise a plurality of output ports that display screen can be provided.Otherwise api layer 1120 can comprise a plurality of output ports.
For a plurality of logical screens of dynamic-configuration on display screen, api layer 1120 can comprise a plurality of software modules, for example, multi-screen manager module " MultiScreenManager " 1210, multi-screen context module " MultiScreenContext " 1230, multi-screen context detectaphone module " MultiScreenContextListener " 1250 and multi-screen context events module " MultiScreenContextEvent " 1240, as shown in figure 13.
Multi-screen manager module 1210 management multi-screen context module 1230, the screen of search expectation, show the information of specifying which device of Screen sharing, the registration of registration multi-screen context detectaphone module 1250 or cancellation multi-screen context detectaphone module 1250.
Multi-screen context module 1230 is interface object relevant with screen object 1220, and determines that according to the interface operation that multi-screen context module 1230 is carried out screen object 1220 is logical screen or display screen.Various attributes shown in Figure 6 can be set, such as attribute 510 to 570 in multi-screen context module 1230.Multi-screen context module 1230 can provide function " SET ", " ADD ", " GET " and " REMOVE " that describes with reference to Fig. 6.
When changing the attribute information of screen object 1220 by multi-screen context module 1230, multi-screen context events module 1240 is as the reformed event class of attribute information of announcing screen object 1220, and multi-screen context detectaphone module 1250 is used as can be with the detectaphone interface object of predetermined application class realization, and described predetermined application class attempts receiving the incident that multi-screen context events module 1240 is pointed out.
Using 1260 is the modules that drive on application layer 1130.Use 1260 and allow the user to select the service of expecting, and on display screen, freely arrange a plurality of logical screens.
At length, use 1260 and will allow the various command of user's dynamic-configuration and management logic screen to send to multi-screen manager module 1210, and multi-screen manager module 1210 is controlled and will be operated accordingly by the various command that multi-screen context module 1230 is carried out.
Multi-screen context module 1230 is relevant with screen object 1220, and manages the attribute information of screen object shown in Figure 6 1220.For the attribute information of management screen object 1220, multi-screen context module 1230 can comprise various functions or method.
Multi-screen manager module 1210 receives the service component that various services source provides from device Drive Layer 1110, and executable operations is to show the service component that receives on logical screen or display screen.
Figure 14 be illustrate according to exemplary embodiment of the present invention at the flow chart that shows a plurality of service method that on each respective logic screen, show by module shown in Figure 13 on the display screen.
With reference to Figure 14, at operation S1310, multi-screen manager module 1210 produce display screens and with the corresponding a plurality of logical screens of the quantity of the service that will be performed.
At operation S1320, multi-screen manager module 1210 is connected to logical screen each the corresponding service that receives from device Drive Layer 1110.Multi-screen manager module 1210 can be set to be used for the parameter of logical screen service by the service context object of the service that receives and come each logical screen call method " addServiceContexts ".Method " addServiceContexts " is connected to service with logical screen, and can provide described method by multi-screen context module 1230.
At operation S1330, in case logical screen is connected to each service, multi-screen manager module 1210 just is connected to display screen with logical screen.At this moment, multi-screen manager module 1210 can be set to parameter by the display screen object that logical screen is connected to and comes logical screen call method " setDisplayScreen " to each screen.Method " setDisplayScreen " is connected to display screen with logical screen, and can provide described method by multi-screen context module 1230.
Method " setDisplayScreen " can be set to " public void setDisplayScreen (HScreen screen) throws SecurityException; Illegal StateException ", and the example " HScreen " that this method permission provides as parameter is relevant with current logical screen.In this case, HScreen display screen preferably.
The parameter of method " setDisplayScreen (HScreen screen) " can comprise value " NULL ".In this case, when not having abnormality processing when manner of execution " setDisplayScreen (HScreen screen) ", current logical screen is no longer relevant with display screen.
The abnormal operation that the execution of method " SecurityException " and " IllegalStateException " can be used as method " setDisplayScreen (HScreen screen) " carries out.
When current screen is logical screen, perhaps in the part of the display screen relevant with current logical screen because the characteristic of host platform and can not change the time, executing method " IllegalStateException ".
At operation S1340, determine the zone on the display screen that logical screen will be mapped to respectively.At this moment, can call the preordering method that multi-screen context module 1230 provides, to determine that logical screen is with the zone on the display screen that is shown.
Figure 15 is the state diagram that illustrates according to the operation of the output module 960 of exemplary embodiment of the present invention.Output module 960 can be carried out output port search processing 1510, output port changes processing 1520 or search screen handles 1530.
Handle 1510 in order to carry out the output port search, output module 960 can call method " getOutputPorts ".Method " getOutputPorts " is used to extract the video-out port that display screen is mapped to.The type of the data type of method " getOutputPorts " and the class of bag " org.ocap.hardware " " VideoOutputPort[] " is identical.That is to say that method " getOutputPorts " is returned the set of the example " VideoOutputPort " that is connected to " HScreen ".
At this moment, have two types display screen and be connected under the situation of video-out port at corresponding screen, method " getOutputPorts " is returned at least one example " VideoOutputPorts ".Kind at corresponding screen is that logical screen and logical screen are connected under the situation of display screen, and method " getOutputPorts " is returned the example " VideoOutputPorts " that is connected to display screen.In addition, but be that the logical screen logical screen is not connected under the situation of display screen in the kind of corresponding screen, method " getOutputPorts " return value NULL.
Figure 16 A is the diagrammatic sketch that the example of the code that is used to search for the output port that is connected to screen is shown.In Figure 16 A, to screen object " screen " using method " getOutputPorts " of module " MultiScreenContext ".
Change processing 1520 in order to carry out output port, output port 960 can call method " addOutputPorts " or method " removeOutputPorts ".Method " addOutputPorts " is used for example " VideoOutputPort " is added to the set of the video-out port that shines upon with screen, and have parameter " VideoOutputPort " and a Boolean denotation " removeExisting ", when adding new output port, described method can be removed the screen of previous mapping.
Can by " void add OutputPorts (and org.ocap.hardware.VideoOutputPort[] ports; Boolean removeExisting) throws java.lang.SecurityException, java.lang.IllegalStateException " form come method for expressing " addOutputPorts ".
When the abnormality processing of processing method " addOutputPorts " and when not giving predetermined right, can carry out the unusual of " java.lang.SecurityException ".When making screen can not be mapped to predetermined output port owing to hardware constraints, when the example " VideoOutputPort " for screen can not be changed (for example, when platform is permanently connected to the predetermined set of example " VideoOutputPort "), perhaps be connected to screen and boolean's mark " removeExisting " when not returning true value when predetermined instances " VideoOutputPort ", can have carried out the unusual of " java.lang.SecurityException ".
Method " removeOutputPorts " is used for removing example " VideoOutputPort " from the set of the video-out port that is mapped to corresponding screen, and has parameter " VideoOutputPort ".
Can come method for expressing " removeOutputPorts " by the form of " void remove OutputPort (org.ocap.hardware.VideoOutputPort[] ports) throwsjava.lang.SecurityException; java.lang.IllegalStateException, java.lang.IllegalArgumentException ".
When the abnormality processing of processing method " removeOutputPorts " and when not giving predetermined right, can carry out the unusual of " java.lang.SecurityException ".That is to say, when corresponding screen is not display screen, when the example " VideoOutputPort " for corresponding screen can not be changed (for example, when platform is permanently connected to the predetermined set of example " VideoOutputPort "), can carry out the unusual of " java.lang.IllegalStateException ".In addition, when predetermined instances " VideoOutputPort " when not being connected to corresponding screen, can carry out the unusual of " java.lang.IllegalStateException ".
Figure 16 B is the diagrammatic sketch that the example of the code that is used to change the output port that is connected to screen is shown.In Figure 16 B, to screen object " screen " using method " addOutputPorts " of module " MultiScreenConfigurableContext ".
Handle 1530 in order to carry out search screen, output module 960 can call method " getCompatibleScreens ".Method " getCompatibleScreens " is the method that is used to extract the screen that can be connected to output port, and returns the arrangement of example " HSCreen ".
Here, the screen that can be connected to output port can be the screen with the output port compatibility.For example, the screen that has identical screen ratio or identical resolution with output port.Therefore, can using method " getCompatibleScreens " screen of search can comprise logical screen and output screen.That is to say, but using method " getCompatibleScreens " is searched at least one output screen or logical screen.
Figure 17 illustrates the flow chart that is used for exchanging by module shown in Figure 13 the processing of the service that will show on logical screen.
At operation S1410, the service that exchanges between two logical screens of multi-screen manager module 1210 interim terminations.
Below, at operation S1420, exchange is about the information of service between two logical screens.At this moment, to each call method " removeServiceContexts " in two logical screens and method " addServiceContexts ", thereby exchanging the service context that in two logical screens, is provided with between two logical screens.Method " removeServiceContexts " is removed the service context that is connected to logical screen, and method " addServiceContexts " is added new service context to logical screen.Can provide method " removeServiceContexts " and method " addServiceContexts " by multi-screen context module 1230.According to current exemplary embodiment of the present invention, between logical screen, exchange the information on services of the service that is connected to about logical services, thereby obtain the effect of exchange main screen and sub-screen.In addition, according to current exemplary embodiment of the present invention,, also can between the logical screen of any amount, exchange described service even on display screen, carry out three or more services.
The operation S1430, the service with two logical screens between the generation that is connected the incident that has changed produced.Below, at operation S1440, multi-screen context events module 1240 sends to multi-screen context detectaphone module 1250 with incident, and begins to carry out the up-to-date service that is connected to two logical screens.
Although specifically illustrated and described the present invention with reference to exemplary embodiment of the present invention, but it should be appreciated by those skilled in the art that, under the situation of the spirit and scope of the present invention that do not break away from the claim qualification, can carry out the change of various forms and details to it.Therefore, being appreciated that provides above-mentioned exemplary embodiment only to be used for describing, and will not be interpreted as scope of the present invention is provided with any restriction.
Utilizability on the industry
According to the present invention, for dynamic-configuration provides a plurality of screens of a plurality of contents at the physics display screen, A plurality of screens are connected to various mutually different ports. Therefore, the user can use according to purpose a plurality of Screen.

Claims (8)

1, a kind of equipment that is used to provide a plurality of screens, described equipment comprises:
Service processing module produces an output screen and a plurality of logical screens that are used to show a plurality of services;
Output module is searched for the logical screen combination that can be connected to output port and be mapped to described output screen in described a plurality of logical screens, and described output screen is mapped to output port.
2, equipment as claimed in claim 1, wherein, output module is searched for described logical screen combination by screen attribute and output port with reference to described a plurality of logical screens in described a plurality of logical screens.
3, equipment as claimed in claim 2, wherein, the screen attribute comprises at least one in screen ratio and the resolution.
4, equipment as claimed in claim 1, wherein, output module is mapped to output screen at least one output port the output port that is mapped to except output screen is current.
5, the method for a plurality of screens of a kind of dynamic-configuration, described method comprises:
Produce an output screen and a plurality of logical screens that are used to show a plurality of services;
In described a plurality of logical screens, search for the logical screen combination that can be connected to output port and be mapped to described output screen, described output screen is mapped to output port.
6, method as claimed in claim 5, wherein, search step comprises: search for described logical screen combination by screen attribute and output port with reference to described a plurality of logical screens in described a plurality of logical screens.
7, method as claimed in claim 6, wherein, the screen attribute comprises at least one in screen ratio and the resolution.
8, method as claimed in claim 5 also comprises: output screen is mapped at least one output port the output port that is mapped to except output screen is current.
CNA2007800123118A 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens Pending CN101416495A (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US78957706P 2006-04-06 2006-04-06
US60/789,577 2006-04-06
US60/812,090 2006-06-09
US60/870,471 2006-12-18
KR1020070024326 2007-03-13
US60/918,894 2007-03-20

Publications (1)

Publication Number Publication Date
CN101416495A true CN101416495A (en) 2009-04-22

Family

ID=40595676

Family Applications (11)

Application Number Title Priority Date Filing Date
CNA2007800120942A Pending CN101416490A (en) 2006-04-06 2007-04-04 Apparatus and method for identifying an application in the multiple screens environment
CNA2007800120143A Pending CN101416487A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800120213A Pending CN101416488A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800121837A Pending CN101416492A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method for dynamic configuration of the same
CNA2007800120317A Pending CN101416489A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800122149A Pending CN101416494A (en) 2006-04-06 2007-04-05 Apparatus and method for identifying an application in the multiple screens environment
CNA2007800124017A Pending CN101416496A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800124144A Pending CN101416497A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800121926A Pending CN101416493A (en) 2006-04-06 2007-04-05 Multiple creens equipment and method
CNA2007800123118A Pending CN101416495A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800121146A Pending CN101416491A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens

Family Applications Before (9)

Application Number Title Priority Date Filing Date
CNA2007800120942A Pending CN101416490A (en) 2006-04-06 2007-04-04 Apparatus and method for identifying an application in the multiple screens environment
CNA2007800120143A Pending CN101416487A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800120213A Pending CN101416488A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800121837A Pending CN101416492A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method for dynamic configuration of the same
CNA2007800120317A Pending CN101416489A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800122149A Pending CN101416494A (en) 2006-04-06 2007-04-05 Apparatus and method for identifying an application in the multiple screens environment
CNA2007800124017A Pending CN101416496A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800124144A Pending CN101416497A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CNA2007800121926A Pending CN101416493A (en) 2006-04-06 2007-04-05 Multiple creens equipment and method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CNA2007800121146A Pending CN101416491A (en) 2006-04-06 2007-04-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens

Country Status (1)

Country Link
CN (11) CN101416490A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103631551A (en) * 2012-08-27 2014-03-12 深圳市蓝韵网络有限公司 Local display method for remote desktop in medical consultation system

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101763842B (en) * 2009-11-13 2012-07-11 广东威创视讯科技股份有限公司 Spliced wall body allocation system and position mapping method for establishing display units
KR101743776B1 (en) 2010-09-28 2017-06-05 엘지전자 주식회사 Display apparatus, method thereof and method for transmitting multimedia
CN103176684B (en) * 2011-12-22 2016-09-07 中兴通讯股份有限公司 A kind of method and device of multizone interface switching
US9632648B2 (en) 2012-07-06 2017-04-25 Lg Electronics Inc. Mobile terminal, image display device and user interface provision method using the same
KR102069547B1 (en) * 2013-04-19 2020-01-28 삼성전자주식회사 Method and apparatus for transmitting and receiving additional information in a broadcast communication system
US20180012570A1 (en) * 2016-07-07 2018-01-11 Futurewei Technologies, Inc. Apparatus and method for mapping frame buffers to logical displays
CN111045622B (en) * 2019-11-21 2023-06-30 中国航空工业集团公司西安航空计算技术研究所 Object-oriented display control interface model

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103631551A (en) * 2012-08-27 2014-03-12 深圳市蓝韵网络有限公司 Local display method for remote desktop in medical consultation system

Also Published As

Publication number Publication date
CN101416491A (en) 2009-04-22
CN101416489A (en) 2009-04-22
CN101416497A (en) 2009-04-22
CN101416487A (en) 2009-04-22
CN101416493A (en) 2009-04-22
CN101416492A (en) 2009-04-22
CN101416496A (en) 2009-04-22
CN101416488A (en) 2009-04-22
CN101416490A (en) 2009-04-22
CN101416494A (en) 2009-04-22

Similar Documents

Publication Publication Date Title
CN101238721B (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens
KR20080030977A (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
CN101416495A (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens
JP2009503603A (en) Multiple screen providing apparatus and dynamic configuration method of the multiple screen
KR100917885B1 (en) Method and apparatus for providing a plurality of screens, and a computer readable recording medium having embodied thereon a computer program for executing the method for providing a plurality of screens
MX2008012822A (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens.
KR100791301B1 (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
KR100888595B1 (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
KR20070100112A (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
KR20070017012A (en) Apparatus for providing multiple screens and method for dynamic configuration of the same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication