CN101238719A - Apparatus for providing multiple screens and method of dynamically configuring multiple screens - Google Patents

Apparatus for providing multiple screens and method of dynamically configuring multiple screens Download PDF

Info

Publication number
CN101238719A
CN101238719A CNA2006800288436A CN200680028843A CN101238719A CN 101238719 A CN101238719 A CN 101238719A CN A2006800288436 A CNA2006800288436 A CN A2006800288436A CN 200680028843 A CN200680028843 A CN 200680028843A CN 101238719 A CN101238719 A CN 101238719A
Authority
CN
China
Prior art keywords
screen
display screen
display
service
logical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2006800288436A
Other languages
Chinese (zh)
Other versions
CN101238719B (en
Inventor
李钟昊
李光基
郑云教
格伦·A·亚当斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020060073123A external-priority patent/KR100725421B1/en
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority claimed from PCT/KR2006/003058 external-priority patent/WO2007018370A1/en
Publication of CN101238719A publication Critical patent/CN101238719A/en
Application granted granted Critical
Publication of CN101238719B publication Critical patent/CN101238719B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides an apparatus for providing multiple screens and a method of dynamically configuring the multiple screens. The apparatus for providing multiple screens includes: a service processing module for generating at least one of a logical screen and a display screen displaying service; and an input module for reflecting the logical screen to random position of the display screen, and providing display screen for a plurality of physical display devices.

Description

The method of the equipment and the dynamic-configuration multi-screen of multi-screen is provided
Technical field
Apparatus and method according to the invention relates to configuring multiple screens, more particularly, relates to the multi-screen that plurality of kinds of contents is provided on the single physical display unit is carried out dynamic-configuration.
Background technology
Broadcasting receiver such as the prior art of Digital Television (TV) or top box of digital machine only provides a kind of content element on the single physical display unit, perhaps show main screen and sub-screen on the single physical display unit simultaneously.
Although the broadcasting receiver of prior art can show main screen and sub-screen simultaneously on same display screen, they can only arrange main screen and sub-screen in limited several modes.Under content was displayed on situation in the main screen, all elements of content (that is, video data, voice data and other data) was shown.On the other hand, under content was displayed on situation in the sub-screen, only substantial part element was shown.
Content source comprises such as the broadcast service of satellite broadcasting device, terrestrial broadcasting device or wired broadcasting device, such as the storage medium of digital versatile disc (DVD) or be connected to the external device (ED) of input.Yet the content of using existing broadcasting receiver to show that on display screen so various content source provide is very difficult.
Under interactive TV application environment, suppose and have only a screen to be output on the physical display such as MHP (MHP), senior common application platform (ACAP) and open cable application platform (OCAP).
For example, under interactive TV application environment, adopt user interface (UI) based on home audio/video interaction technique (HAVi).According to HAVi UI standard,, on physical display, also only show a screen usually even the quantity of the screen that shows on the physical display is not limited.
Summary of the invention
Under this environment, when being difficult on content of multimedia being shown to screen independently to being presented at the operation of execution a such as decoding in the content of multimedia on the screen, Digital Signal Processing, user interaction process etc.In addition, also being difficult to the screen is that unit dynamically controls the use of resource and the life cycle of application program.
Therefore, existence is to the demand of the method on the screen that plurality of kinds of contents is presented at dynamic-configuration.
The invention provides a kind of dynamic-configuration that the multi-screen that plurality of kinds of contents is provided is carried out on physical display.
According to an aspect of the present invention, provide a kind of equipment that is used to provide multi-screen.Described equipment comprises: service processing module produces logical screen and is used for showing display screen at least a of service; And output module, logical screen is mapped to the optional position of display screen, and provides display screen for a plurality of physical display.
A kind of method of dynamic-configuration multi-screen is provided according to a further aspect in the invention.Described method comprises: produce logical screen and be used for showing display screen at least a of the service of recovery; Logical screen is mapped to the optional position of display screen; With provide display screen for a plurality of physical display.
Description of drawings
By the detailed description of reference accompanying drawing to exemplary embodiment of the present, above and other aspect of the present invention will become clearer, wherein:
Figure 1A to Fig. 1 H illustrates the diagrammatic sketch of the configuration of PIP screen according to an exemplary embodiment of the present invention;
Fig. 2 illustrates the diagrammatic sketch of the relation between the logical screen and display screen according to an exemplary embodiment of the present invention;
Fig. 3 A is the diagrammatic sketch that the configuration of the screen that comprises mapping program according to an exemplary embodiment of the present invention is shown to Fig. 3 E;
Fig. 4 illustrates the block diagram of serving the source according to an exemplary embodiment of the present invention;
Fig. 5 A and Fig. 5 B illustrate the diagrammatic sketch of abstract service and non-abstract service according to an exemplary embodiment of the present invention;
Fig. 6 illustrates the interface of logical screen and display screen and the diagrammatic sketch of attribute information;
Fig. 7 illustrates the diagrammatic sketch of the attribute of logical screen " z order " according to an exemplary embodiment of the present invention;
Fig. 8 A and Fig. 8 B illustrate the diagrammatic sketch of the attribute of logical screen " viewing area " according to an exemplary embodiment of the present invention respectively;
Fig. 9 illustrates according to an exemplary embodiment of the present invention with the diagrammatic sketch of two map of services to the method for display screen;
Figure 10 is the block diagram that the configuration of the equipment that is used to provide multi-screen according to an exemplary embodiment of the present invention is shown;
Figure 11 illustrates the diagrammatic sketch that output module according to an exemplary embodiment of the present invention is connected to display screen the state of a plurality of physical display;
Figure 12 illustrates the flow chart of the method for dynamic-configuration multi-screen according to an exemplary embodiment of the present invention;
Figure 13 is the diagrammatic sketch that the software architecture that is used to provide multi-screen according to an exemplary embodiment of the present invention is shown;
Figure 14 is the diagrammatic sketch that the relation between the module that constitutes application programming interfaces (API) layer according to an exemplary embodiment of the present invention is shown; With
Figure 15 illustrates according to an exemplary embodiment of the present invention by module shown in Figure 14 to be presented at the flow chart that multinomial service on each corresponding logical screen is presented at the method on the display screen.
Embodiment
By with reference to following the detailed description and the accompanying drawings to exemplary embodiment, advantage of the present invention and characteristics and realize that method of the present invention can more easily be understood.Yet the present invention can be implemented with many different forms, and should not be construed as limited to the exemplary embodiment of setting forth here.On the contrary, these exemplary embodiments are provided so that the disclosure is comprehensive and complete, and fully pass on design of the present invention to those skilled in the art, and the present invention will only be defined by the claims.In whole specification, identical label is represented identical parts.
Before explaining the present invention, now the term that uses in the specification will be described simply.Yet, should be noted that unless stated otherwise, otherwise the use of any and whole example that provides here or exemplary term only is used for the present invention is shown better, and scope of the present invention do not limited.
One group of content of multimedia that term " service " expression shows together, that is, at least one serviced component forms single service.
Serviced component is the element of service, and comprises video component, audio-frequency assembly and data package.Video component and audio-frequency assembly comprise video information and audio-frequency information respectively.In addition, data package is meant the application in the service, and data package comprises: provide Weather information application, provide stock information application, the application of captions or electronic program guides (EPG) is provided.
The object of the execution of term " service context " expression may command service, and various resources, device and the execution state information that provides service required is provided.Can confirm the serviced component of the configuration element of conduct service by service context.
Physical unit, the external output port of output content or the storage medium of stores service of the content of term " physical display " expression actual displayed service.
The screen of actual displayed on term " display screen " the expression physical display.In display screen, any service can be set directly, and on physical display, can show this display screen.At least one logical screen that selectively, on physical display, can show the specific region that is mapped to display screen.
Term " logical screen " expression shows the space of service arbitrarily.Before being mapped to display screen, logical screen is a virtual screen, so logical screen is not displayed on the physical display.Therefore logical screen is displayed on the physical display by being mapped to display screen.
Logical screen and display screen can be the combinations of stationary background image, video raster (raster) and figure grating.The figure grating can be the combination of text, lines, color and image or the mixing of frame of video.
Term " main service " expression by the user by being presented at menu or the remote controller on the physical display or by using the service that is chosen as main service by API, the screen that main service is shown thereon is called as " main screen ".
Term " picture in picture service " (PIP service) is illustrated in the main service by the user by being presented at menu or the remote controller on the physical display or by using the service that is chosen as sub-services by API, the PIP service can be presented in picture-in-picture screen (PIP screen) or the main screen.
The PIP screen comprises the screen of the part that occupies another screen shown in Figure 1A to Fig. 1 D, and shown in Fig. 1 E to Fig. 1 F with the nonoverlapping situation of another screen under the screen that shows simultaneously with another screen.In this case, should be appreciated that shown in Fig. 1 G and Fig. 1 H, the PIP screen can comprise the optional position that is presented in the physical display or go up in the zone and the screen of another screen overlay.
If necessary, will the term that not be described in above-mentioned be described.Below, detailed description exemplary embodiment with reference to the accompanying drawings.
Fig. 2 illustrates the diagrammatic sketch of the relation between the logical screen and display screen according to an exemplary embodiment of the present invention.
With reference to Fig. 2, can use logical screen 210,212 and 214 to show service.Logical screen 210,212 and 214 is mapped to display screen 220,222 and 224 by mapping block 230.
Say that at length logical screen 210 and 212 is mapped to display screen 220, logical screen 212 and 214 is mapped to display screen 222, and logical screen 210,212 and 214 is mapped to display screen 224.
In brief, mapping block 230 shows that with at least one the logical screen of service is mapped to the arbitrary region of display screen.
Mapping block 230 is one group logical screen is mapped to the required various information of display screen.The example of described various information comprises: the identification information of coordinate information, logical screen and the display screen of the presumptive area on each display screen that is mapped in a plurality of logical screens and regulation are with the information of what kind of order display logic screen on display screen.
Mapping block 230 can change the size of logical screen so that it is distributed in the arbitrary region of display screen.That is, but the convergent-divergent of mapping block 230 actuating logic screens and the distribution of position thereof, and Fig. 3 A is the diagrammatic sketch of configuration that the screen of the mapping program (mapper) that comprises as mapping block is shown to Fig. 3 E.
With reference to Fig. 3 A, mapping program will comprise that with normal size the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain.Mapping program will only comprise that with the size of dwindling the PIP screen of video component is mapped to the entire display screen curtain.In this case, the PIP screen of mapping is displayed on the main screen, and this determines based on the Z value.Symbols Z is meant after a while with the z order value of describing.Overlapping screen can make up with display screen.Overlapping screen is to be positioned at outermost specific screens, uses when caption function is provided.As shown in Figure 3A, the PIP screen can only have video component, perhaps can have the combination of stationary background image B, video raster V and figure grating G shown in Fig. 3 B.
With reference to Fig. 3 C, mapping program will comprise that with normal size the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain.Mapping program will only have two PIP screen #1 of video component and the arbitrary region that #2 is mapped to display screen with the size of dwindling.In this case, the PIP screen of mapping is positioned on the main screen, and the Z value can remain unchanged.In addition, overlapping screen can make up with display screen.Shown in Fig. 3 C, the configuration of screen can have a plurality of PIP screens that only comprise video component, and perhaps shown in 3D, the configuration of screen can have a plurality of PIP screens of the combination that comprises stationary background image B, video raster V and figure grating G.
Fig. 3 E shows picture out picture (POP) screen.Be appreciated that the PIP screen shows in main screen, and the POP screen shows outside main screen.With reference to Fig. 3 E, mapping program will comprise a plurality of PIP screen #1 of combination of stationary background image B, video raster V and figure grating G and the arbitrary region that #2 is mapped to display screen with the size that reduces.In this case, the Z value of the POP screen #1 of mapping and #2 can remain unchanged.In addition, overlapping screen can make up with display screen.
Mapping block 230 can be realized by interface or function that the various computer programming languages that will be performed are write, and mapping block 230 can be by creating above-mentioned information or changing relation between logical screen and the display screen as parameter.
Mapping block 230 also can be realized by hardware, so that logical screen is mapped to display screen.
In addition, as shown in Figure 4, the service that various services source provides can be displayed on the display screen, and display screen can be displayed on the physical display.
There is following multiple service source: such as the service source that broadcast service is provided of terrestrial broadcasting device 320 and wired broadcasting device 330, such as the service source that the service that is stored in the storage medium is provided of personal video record (PVR) 340, and the service source (not shown among Fig. 4) that service is provided by cable network or wireless network.
Broadcasting receiver 310 receives service and produces the logical screen of the service that shows each reception from the service source.
Then, by the method for using the predefine method or be provided with any service is set directly on the display screen that will be displayed on the physical display by user or application.Otherwise, on physical display 350, show at least one logical screen that is mapped to the arbitrary region on the display screen.In brief, the service that provides of terrestrial broadcasting device 320, wired broadcasting device 330 and PVR 340 is displayed on the physical display 350.
The device of terrestrial broadcasting shown in Fig. 4 320, wired broadcasting device 330 and PVR 340 still the invention is not restricted to this as the service source.According to an exemplary embodiment of the present, provide the content of multimedia source of any kind of the content of multimedia that can be shown together can be as the service source.
Shown in Fig. 5 A and Fig. 5 B, service can be divided into abstract service and non-abstract service according to an exemplary embodiment of the present invention.
Abstract service is not the service that the broadcast singal by real-time transmission provides, but is independent of the service of broadcasting channel.Abstract service only comprises data package (that is, using), and does not comprise video component and audio-frequency assembly.The example of abstract service comprises the service that not binding is used that has based on the OCAP standard.
Non-abstract service is understood that the service except abstract service.
The current exemplary embodiment according to the present invention, abstract service and non-abstract service all have independence.For example, abstract service can directly be set on physical display by logical screen, and can on logical screen, show non-abstract service.Then, logical screen can be mapped to the display screen that is provided with abstract service.Can pass through physical display output display screen curtain thereafter.Thus, can be independent of non-abstract service and on display screen, show abstract service.In addition, abstract service can be mapped to different logical screens with non-abstract service.Logical screen can be mapped to single display screen thereafter.In other words, can be independent of non-abstract service and on display screen, show abstract service.
The current exemplary embodiment according to the present invention can be categorized as different objects with logical screen and display screen.Selectively, screen can be used as logical screen or display screen according to the attribute information of a screen object.
That is, can confirm that screen is logical screen or display screen based on the type information in the attribute information of screen object.
The attribute information of screen object comprises multiple attribute: " type ", " z order ", " viewing area ", " observability ", " related display screen ", " association service context " and " output port ".
Fig. 6 shows the attribute information of screen object and is used to handle the type of the interface of described attribute information.
Attribute " type " the 505th, being used for instruction screen is the logical screen or the attribute information of display screen.
Attribute " z order " 510 is used for determining what kind of order to arrange a plurality of logical screens along the z axle with.Fig. 7 shows the combination of the value of the attribute " z order " for logical screen, the configuration of the logical screen on the physical display.
With reference to Fig. 7, first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610 respectively.Say that at length first logical screen 620 is presented on the display screen 610, second logical screen 630 and first logical screen 620 are presented on the display screen with overlapping.In other words, display screen 610, first logical screen 620 and second logical screen 630 are disposed in order along the z direction of principal axis.In this case, can be with attribute " z order " value of being set to 1 of first logical screen 620, can be with attribute " z order " value of being set to 2 of second logical screen 630.The certain order that first logical screen 620 and second logical screen 630 are arranged along the z axle can be represented the attribute " z order " of first logical screen 620 and second logical screen 630 can be set to Any Digit or character, as long as in described numeral or character.
Attribute " viewing area " the 520th is about the information in the display screen zone of logical screen, shown in Fig. 8 A and Fig. 8 B.
Fig. 8 A shows the whole zone that logical screen 710 is mapped to display screen 720, and Fig. 8 B shows the subregion that logical screen 730 is mapped to display screen 740.
Attribute " viewing area " 520 can comprise the information of regulation logical screen with the two-dimensional coordinate of the predetermined portions of the display screen that is mapped to, can comprise that perhaps what deviant the information in the precalculated position on the regulation display screen and indication logical screen depart from from the described precalculated position on the display screen.
Attribute " observability " 530 definite logical screens are presented on the display screen visibly invisibly to be presented on the display screen.By changing the value of attribute " observability " 530, logical screen is appeared on the display screen or from display screen disappear.
Attribute " related display screen " the 540th is about the information of the display screen that is associated with logical screen.The logical screen all unconnected with any display screen may not can be displayed on the physical display, also can not be sent to outside output device.
Attribute " association service context " the 550th is about the information of the service context that is connected to logical screen or display screen.The service that is provided with in such service context can be presented on logical screen or the display screen.
Attribute " output port " the 560th, about the information of the device of output display screen curtain, such device comprises indicator screen, wire/wireless communication medium and various storage medium.
Can be provided for discerning or changing the interface of the value of attribute shown in Figure 6.With reference to Fig. 6, described interface can comprise: interface " Set " is used to set property or logical screen is connected to display screen; Interface " Add " is used to add property value or logical screen is connected to service; Interface " Get " is used for the recognition property value; And interface " Remove ", be used for the delete property value.These interfaces can comprise processing, function, step respectively or carry out the method for their function.
For example, method " getDisplayScreen (void) " is returned the display screen that is associated with current screen.Say that at length if current screen is a logical screen, then method " getDisplayScreen (void) " is returned related display screen.If current screen is a display screen, then method " getDisplayScreen (void) " is returned the reference information about current screen.In addition,, but there is not related screen, then method " getDisplayScreen (void) " return value " NULL " if current screen is a logical screen.
According to another example, method " public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException " is provided for current logical screen is mapped to the function of the presumptive area of related display screen.The example as parameter that is provided is the class " HScreenRectangle " of bag " org.havi.ui ", and described example has two-dimensional position information.The abnormal operation that the execution of method " SecurityException " and " IllegalStateException " can be used as method " setDisplayScreen (HScreen screen) " carries out.Current screen be the part of logical screen or the display screen that is associated with current logical screen because the characteristic of host platform and can not be changed the time, executing method " IllegalStateException ".
According to another example, method " getDisplayArea (void) " is returned the area information of current screen as HScreenRectangle information.If current screen is corresponding to display screen, then method " getDisplayArea (void) " is returned the HScreenRectangle information with value identical with HScreenRectangle (0,0,1,1).If current screen is a logical screen, then method " getDisplayArea (void) " is returned the information in the zone on the display screen that occupies about current screen.If current screen is a logical screen, but all unconnected with any display screen, method " getDisplayArea (void) " return value " NULL " then.
In the following description, use particular term to represent special interface all the time.Yet, it will be understood by those skilled in the art that specific function named only to be used to indicate its function.The detailed description of exemplary embodiment is with function but not title is distinguished function.
Fig. 9 is illustrated in the diagrammatic sketch that the processing of two services is set with being mapped on two logical screens of single display screen.
With reference to Fig. 9, first service comprises all three kinds of serviced components, i.e. video, audio frequency and data package, and second service only comprises video and audio-frequency assembly.Yet the present invention is in addition any restriction of serviced component, and first service and second shown in Figure 9 to serve all be exemplary.
As shown in Figure 9, first service and second service are to be displayed on the physical display with prior art mode much at one.According to current exemplary embodiment of the present invention, not to can in addition under the situation of any restriction, can on physical display, showing multinomial service independently of one another in the quantity of the service that shows on the single display screen.
Figure 10 is the block diagram that is used to provide the equipment of multi-screen according to an exemplary embodiment of the present invention.
With reference to Figure 10, be used to provide the equipment 900 of multi-screen to comprise: digital signal processing module 940, service processing module 950, output module 960 and user/AIM 965.
In addition, equipment 900 also comprises broadcast singal receiver module 910, storage medium 920 and outside input module 930 as the service source, and comprises that physical display 970, storage medium 980 and outside output module 990 are as the service output medium.
The meaning of term used herein " module " is, but is not limited to, and carries out the software or the nextport hardware component NextPort of particular task, such as field programmable gate array (FPGA) or application-specific integrated circuit (ASIC) (ASIC).Module can be configured to easily and reside on addressable storage medium, and can be configured on one or more processors and carry out.Therefore, for instance, module can comprise: such as assembly, process, function, attribute, process, subprogram, program code segments, driver, firmware, microcode, circuit, data, database, data structure, table, array and the variable of component software, OO component software, class component and task component.The function that provides in assembly and module can be combined into assembly and module still less, perhaps can further be separated into other assembly and module.
The various information that digital signal processing module 940 receives such as the service of content of multimedia from broadcast singal receiver module 910, storage medium 920 or outside input module 930 are as video information, audio-frequency information or data message.
Broadcast singal receiver module 910 receives satellite, ground or cable broadcasting signal and sends the broadcast singal that receives, video information, audio-frequency information or the data message of storage medium 920 stores service, outside input module 930 is from receiving video information, audio-frequency information or the data message of service such as the external device (ED) that is connected to the network of network interface module.
Digital signal processing module 940 uses the serviced component that receives to recover multinomial service.The service that recovers comprises abstract service or non-abstract service.
Here, phrase " multinomial service " refers to two or the more multinomial service that is sent by broadcast singal receiver module 910, perhaps two or the more multinomial service that is sent by broadcast singal receiver module 910 and storage medium 920 respectively.
Digital signal processing module 940 can recover to serve according to user or the selection of using by user/AIM 965.In this case, user or application can be selected the connection between service arbitrarily and the screen.
Service processing module 950 produces logical screen and display screen, with the service that shows that digital signal processing module 940 recovers.Specifically, service processing module 950 will be served with logical screen and will be connected.In addition, the service that digital signal processing module 940 recovers can not be connected to the logical screen in the service processing module 950, and is directly connected to display screen.
Output module 960 is mapped to display screen with a plurality of logical screens that service processing module 950 produces.Can use predefined method or carry out the mapping of logical screen by means of the method that user/AIM 965 is provided with to display screen by the user.
The display screen that output module 960 provides can be displayed on the physical display 970, perhaps can be stored in the storage medium 980.The example of storage medium 980 comprises computer-readable floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, BD (Blu-ray disc) and semiconductor memory.
In addition, the display screen that provides of output module 960 can be sent to the external device (ED) that is connected to network through outside output module 990.
For this reason, output module 960 can comprise a plurality of output ports, can provide display screen by described a plurality of output ports.In this case, can provide display screen by acquiescence output port that sets in advance or the output port of selecting by means of user/AIM 965 by the user.
Multi-screen generator 900 can show one or multinomial service simultaneously on a plurality of physical display.For this reason, as shown in figure 11, output module 960 provides at least one display screen for a plurality of physical display 970-1,970-2......972-N, and manages the annexation between described display screen and a plurality of physical display 970-1, the 970-2......972-N.
Output module 960 can provide identical display screen on a plurality of physical display 970-1,970-2......972-N, perhaps provide with a plurality of physical display 970-1,970-2......972-N in each corresponding different display screen.Can or use by the user uses user/AIM 965 to be defined as the method that physical display provides display screen.In addition, output module 960 is in response to the request of user or application, provide about offering each the information of display screen among physical display 970-1, the 970-2......972-N, for example, the annexation between described display screen and described physical display 970-1, the 970-2......972-N.In addition, output module 960 can change the annexation between described display screen and described physical display 970-1, the 970-2......972-N.
User or application can be by the services of using user/AIM 965 select one of multinomial service or recover to expect.In addition, the user can select one of a plurality of display screens by using user/AIM 965.
Because module shown in Figure 10 is divided according to its function, so can be connected to other modules.
Figure 12 illustrates the flow chart of the method for dynamic-configuration multi-screen according to an exemplary embodiment of the present invention.
Usually, video information, audio-frequency information and the data message of formation content of multimedia are sent out with predetermined format (for example, mpeg stream form).In operation S1010, digital signal processing module 940 receiver, video information, audio-frequency information and data message, and based on the video information that receives, audio-frequency information and data message recovery service.Here, the service that recovers in operation S1010 can or pre-determine by user or application choice.The user can use and be presented at the menu that shows on the display unit or remote controller and select connection between any screen and the screen.Application can use API to select to connect.
In addition, data message comprises the application message about the application program that is used to serve, and these application messages comprise the signal message whether the indication application program can be moved on the PIP screen.The example of application message comprises based on the application information table of MHP standard (AIT) with based on the application information table (XAIT) of the expansion of OCAP standard.Signal message can be added in the application message.
Thereafter, in operation S1020, service processing module 950 produces the screen that shows the service that recovers on it.In operation 1030, the screen of generation is connected to the service of recovery.The screen that produces in operation S1020 comprises logical screen and display screen.
In operation 1040, output module 960 is mapped to display screen with logical screen, in operation S1050, display screen is offered at least one indicator screen subsequently.Output module 960 also can provide the display screen of the service that is connected to by service processing module 950, and logical screen is not shone upon.Output module 960 also can be carried out the operation of the annexation between management display screen and the physical display.
The service of the recovery shown in Figure 12 is displayed on the physical display by logical screen.Yet the service of recovery can directly not be displayed on the physical display by logical screen.
When the user selected the PIP service, the PIP service realized with two kinds of patterns.In first pattern, the video component of the PIP service of selection only is provided on main screen, and is not the independent logical screen of PIP service-creation, that is, and the PIP screen.In second pattern, create the independent logical screen that is used for the PIP service, on the PIP screen of creating so that the PIP service of selection to be provided.
Figure 12 shows for the sake of simplicity only with the method for a map of services to display screen.Yet, can use or not use a plurality of logical screens that multinomial map of services is arrived display screen.
When by this way display screen being offered the user, the user can carry out multinomial service.
Figure 13 is the diagrammatic sketch that the software architecture that multi-screen is provided according to an exemplary embodiment of the present invention is shown.
With reference to Figure 13, software architecture 1100 comprises: device driver layer 1110, api layer 1120 and application layer 1130.
Device driver layer 1110 receives serviced component from various content of multimedia source, to the serviced component decoding that receives.The example of the serviced component that receives comprises: video information, audio-frequency information and data message.
Api layer 1120 produces logical screen and display screen, and service, logical screen and display screen are shone upon each other.
Thereby application layer 1130 provides the user interface user dynamically to dispose the logical screen that shows service, perhaps user command is sent to api layer 1120, thereby api layer 1120 can be carried out user command.
The user makes device driver layer 1110 provide display screen through physical display by application layer 1130, perhaps stores display screen in storage medium.In addition, the user can make device driver layer 1110 display screen be sent to external device (ED) through network.
For this reason, device driver layer 1110 can comprise a plurality of output ports that display screen can be provided.Otherwise api layer 1120 can comprise a plurality of output ports.
As shown in figure 14, for a plurality of logical screens on the dynamic-configuration display screen, api layer 1120 can comprise a plurality of software modules, for example, multi-screen management program module " MultiScreenManager " 1210, multi-screen context module " MultiScreenContext " 1230, multi-screen context oracle listener module " MultiScreenContextListener " 1250 and multi-screen context events module " MultiScreenContextEvent " 1240.
Multi-screen management program module 1210 management multi-screen context module 1230, the screen of search expectation, the information that shows what device of a plurality of Screen sharing of regulation, registration multi-screen context oracle listener module 1250, or the registration of cancellation multi-screen context oracle listener module 1250.
Multi-screen context module 1230 is interface object relevant with screen object 1220, and determines that according to the interface operation that multi-screen context module 1230 is carried out screen object 1220 will become logical screen or display screen.The various attributes of all attributes 505 to 570 as shown in Figure 6 can be set in multi-screen context module 1230.Multi-screen context module 1230 can provide function " Set ", " Add ", " Get " and " Remove " that as above describes with reference to Fig. 6.
When changing the attribute information of screen object 1220 by multi-screen context module 1230, the event class that multi-screen context events module 1240 has changed as the attribute information of announcing screen object 1220, and multi-screen context oracle listener module 1250 is used as can be with the oracle listener interface object of predetermined application class realization, and described predetermined application class attempts receiving the incident that multi-screen context events module 1240 is pointed out.
Using 1260 is driven modules on application layer 1130.Application 1260 makes the user select the service of expectation on display screen and freely arranges a plurality of logical screens.
At length say, use 1260 various commands that will allow the user dynamically to dispose with the management logic screen and send to multi-screen management program module 1210,1210 controls of multi-screen management program module with will operate accordingly by the various command of multi-screen context module 1230 execution.
Multi-screen context module 1230 is associated with screen object 1220, and manages the attribute information of screen object shown in Figure 6 1220.For the attribute information of management screen object 1220, multi-screen context module 1230 can comprise multiple function or method.
According to an exemplary embodiment of the present, multi-screen management program module 1210 receives the serviced component that is provided by various services source from device driver layer 1110, and executable operations is presented on logical screen or the display screen with the serviced component that will receive.In addition, above-mentioned functions also can be carried out by another module (not shown).
Figure 15 illustrates according to an exemplary embodiment of the present invention by module shown in Figure 14 to be presented at the flow chart that multinomial service on each corresponding logical screen is presented at the method on the display screen.
With reference to Figure 15, in operation S1310, multi-screen management program module 1210 produce display screens and with the logical screen of the quantity respective numbers of the service that will be performed.
In operation S1320, multi-screen management program module 1210 is connected to logical screen each the corresponding service that receives from device driver layer 1110.Multi-screen management program module 1210 can be set to the parameter of logical screen service by the service context object of the service that receives, comes each logical screen call method " addServiceContext ".Method " addServiceContext " is connected to service with logical screen, and can be provided by multi-screen context module 1230.
In operation S1330, in case logical screen is connected to each service, multi-screen management program module 1210 just is connected to display screen with logical screen.At this moment, multi-screen management program module 1210 can be set to parameter by the display screen object that logical screen was connected to, and comes each logical screen call method " setDisplayScreen ".Method " setDisplayScreen " is connected to display screen with logical screen, and can be provided by multi-screen context module 1230.
Method " setDisplayScreen " can be set to " public void setDisplayScreen (HScreen screen) throws SecurityException; IllegalStateException ", and described method makes the example " HScreen " that provides as parameter be associated with current logical screen.In this case, example " HScreen " is preferably display screen.
The parameter of method " setDisplayScreen (HScreen screen) " can comprise value " NULL ".In this case, when not having abnormality processing ground manner of execution " setDisplayScreen (HScreen screen) ", current logical screen no longer is associated with display screen.
The abnormal operation that the execution of method " SecurityException " and " IllegalStateException " can be used as method " setDisplayScreen (HScreen screen) " carries out.
Current screen be the part of logical screen or the display screen that is associated with current logical screen because the characteristic of host platform and can not be changed the time, executing method " IllegalStateException ".
In operation Sl340, determine the zone on the display screen that logical screen is mapped to respectively.At this moment, can call the preordering method that multi-screen context module 1230 provides, to determine with the zone on the display screen of display logic screen.
Utilizability on the industry
According to the present invention, can be by using the multinomial service that the single physical display screen is carried out in every way to be provided by each provenance (as wired broadcasting, terrestrial broadcasting, various storage medium and outside input).
Although specifically illustrate and described the present invention with reference to exemplary embodiment of the present invention, but it should be understood by one skilled in the art that, under the situation that does not break away from the spirit and scope of the present invention that are defined by the claims, can carry out various changes to it in form and details.Therefore, should be appreciated that the foregoing description only is provided on descriptive meaning, and should not be interpreted as scope of the present invention any restriction in addition.

Claims (15)

1, a kind of equipment that is used to provide multi-screen, described equipment comprises:
Service processing module produces at least a of a plurality of logical screens and a plurality of display screens that are used for showing service; With
Output module is mapped to the optional position of display screen with logical screen, and provides display screen for a plurality of physical display.
2, equipment as claimed in claim 1, wherein, output module is in response to the request change display screen of user or application and the annexation between the physical display.
3, equipment as claimed in claim 1, wherein, output module provides information about the annexation between display screen and the physical display in response to the request of user or application.
4, equipment as claimed in claim 1, wherein, output module provides different display screens for described a plurality of physical display.
5, equipment as claimed in claim 1, wherein, output module provides identical display screen for described a plurality of physical display.
6, equipment as claimed in claim 1 also comprises:
Interface module receives the request that is used to connect display screen and physical display by described interface module from user or application.
7, equipment as claimed in claim 1, wherein, described service comprises at least one in video information, audio-frequency information and the data message.
8, equipment as claimed in claim 7 wherein, provides described video information, audio-frequency information and data message by broadcast singal, storage medium or network.
9, a kind of method of dynamic-configuration multi-screen, described method comprises:
Produce at least a of a plurality of logical screens and a plurality of display screens that are used for showing service;
Logical screen is mapped to the optional position of display screen; With
For a plurality of physical display provide display screen.
10, method as claimed in claim 9 also comprises:
In response to the request change display screen of user or application and the annexation between the physical display.
11, method as claimed in claim 9 also comprises:
Provide information in response to the request of user or application about the annexation between display screen and the physical display.
12, method as claimed in claim 9 wherein, provides the step of display screen to comprise: for described a plurality of physical display provide different display screens respectively.
13, method as claimed in claim 9 wherein, provides the step of display screen to comprise: for described different physical display provides identical display screen.
14, method as claimed in claim 9, wherein, described service comprises at least one in video information, audio-frequency information and the data message.
15, method as claimed in claim 14 wherein, provides described video information, audio-frequency information and data message by broadcast singal, storage medium or network.
CN2006800288436A 2005-08-05 2006-08-03 Apparatus for providing multiple screens and method of dynamically configuring multiple screens Expired - Fee Related CN101238719B (en)

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
US70549105P 2005-08-05 2005-08-05
US60/705,491 2005-08-05
US78957706P 2006-04-06 2006-04-06
US60/789,577 2006-04-06
US81209006P 2006-06-09 2006-06-09
US60/812,090 2006-06-09
KR1020060073123A KR100725421B1 (en) 2005-08-05 2006-08-02 Apparatus for providing multiple screens and method for dynamic configuration of the same
KR10-2006-0073123 2006-08-02
KR1020060073123 2006-08-02
PCT/KR2006/003058 WO2007018370A1 (en) 2005-08-05 2006-08-03 Apparatus for providing multiple screens and method of dynamically configuring multiple screens

Publications (2)

Publication Number Publication Date
CN101238719A true CN101238719A (en) 2008-08-06
CN101238719B CN101238719B (en) 2012-05-30

Family

ID=39899027

Family Applications (13)

Application Number Title Priority Date Filing Date
CN2006800288436A Expired - Fee Related CN101238719B (en) 2005-08-05 2006-08-03 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN200680028909A Expired - Fee Related CN100581226C (en) 2005-08-05 2006-08-03 Apparatus for providing a plurality of screens and method of dynamically configuring a plurality of screens
CN2006800286553A Expired - Fee Related CN101238717B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800291848A Expired - Fee Related CN101238722B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN200680028821XA Expired - Fee Related CN101238718B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800283767A Expired - Fee Related CN101233750B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800285086A Expired - Fee Related CN101238715B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800282868A Expired - Fee Related CN101233747B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN200680028518XA Expired - Fee Related CN101238716B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800283663A Expired - Fee Related CN101233748B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800289316A Expired - Fee Related CN101238721B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800285207A Expired - Fee Related CN101238724B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800283860A Expired - Fee Related CN101233749B (en) 2005-08-05 2006-08-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens

Family Applications After (12)

Application Number Title Priority Date Filing Date
CN200680028909A Expired - Fee Related CN100581226C (en) 2005-08-05 2006-08-03 Apparatus for providing a plurality of screens and method of dynamically configuring a plurality of screens
CN2006800286553A Expired - Fee Related CN101238717B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800291848A Expired - Fee Related CN101238722B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN200680028821XA Expired - Fee Related CN101238718B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800283767A Expired - Fee Related CN101233750B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800285086A Expired - Fee Related CN101238715B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800282868A Expired - Fee Related CN101233747B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN200680028518XA Expired - Fee Related CN101238716B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800283663A Expired - Fee Related CN101233748B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800289316A Expired - Fee Related CN101238721B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800285207A Expired - Fee Related CN101238724B (en) 2005-08-05 2006-08-04 Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN2006800283860A Expired - Fee Related CN101233749B (en) 2005-08-05 2006-08-05 Apparatus for providing multiple screens and method of dynamically configuring multiple screens

Country Status (1)

Country Link
CN (13) CN101238719B (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9182937B2 (en) * 2010-10-01 2015-11-10 Z124 Desktop reveal by moving a logical display stack with gestures
KR20100070146A (en) * 2008-12-17 2010-06-25 삼성전자주식회사 Display method and photographing apparatus and display apparatus using the same
JP2012047842A (en) * 2010-08-25 2012-03-08 Seiko Epson Corp Image display device, and image display method
JP5892361B2 (en) * 2011-08-02 2016-03-23 ソニー株式会社 Control device, control method, program, and robot control system
JP5796566B2 (en) * 2011-12-28 2015-10-21 株式会社デンソー Display control device
CN102547143A (en) * 2012-01-13 2012-07-04 深圳市华泰敏信息技术有限公司 Method and device for building mapping relation between outlet port of video switching equipment and displayer
CN102663988B (en) * 2012-04-28 2015-06-24 广东威创视讯科技股份有限公司 Method, device and system for broadcasting subtitles
KR101952724B1 (en) * 2012-07-31 2019-02-28 삼성전자주식회사 Apparatus and method for supplying n-screen service in broadcast system
CN103838503B (en) * 2012-11-26 2017-02-08 华为技术有限公司 Multiple-application display method and device
KR102069547B1 (en) * 2013-04-19 2020-01-28 삼성전자주식회사 Method and apparatus for transmitting and receiving additional information in a broadcast communication system
CN104427374B (en) * 2013-08-27 2018-03-20 海尔集团公司 Display control method, device and the multimedia equipment of content of multimedia
CN104270661A (en) * 2014-10-24 2015-01-07 冠捷显示科技(厦门)有限公司 System and displaying method for extended display equipment of intelligent television
CN104537573A (en) * 2014-12-17 2015-04-22 国家电网公司 Power grid operation information panoramic visualized display system
US9652196B2 (en) * 2015-06-29 2017-05-16 Microsoft Technology Licensing, Llc Smart audio routing management
CN106254928B (en) * 2016-08-19 2019-07-30 青岛海信电器股份有限公司 A kind of picture caption presentation method and device
CN111711843A (en) * 2020-06-09 2020-09-25 海信视像科技股份有限公司 Multimedia equipment and screen projection playing method
CN112181335B (en) * 2020-09-25 2023-08-15 北京博睿维讯科技有限公司 Multi-signal comprehensive management and control method, intelligent terminal and storage medium

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5347624A (en) * 1987-03-05 1994-09-13 Hitachi, Ltd. Method and apparatus for display control
GB9200269D0 (en) * 1992-01-08 1992-02-26 Thomson Consumer Electronics Programmable pop for wide screen television
CA2187796C (en) * 1994-04-15 2010-06-29 Jurgen Fritz Rosengren Arrangement and method for transmitting and receiving video signals
US5867223A (en) * 1995-07-17 1999-02-02 Gateway 2000, Inc. System for assigning multichannel audio signals to independent wireless audio output devices
US5805118A (en) * 1995-12-22 1998-09-08 Research Foundation Of The State Of New York Display protocol specification with session configuration and multiple monitors
US6088005A (en) * 1996-01-11 2000-07-11 Hewlett-Packard Company Design and method for a large, virtual workspace
JP3509060B2 (en) * 1998-05-28 2004-03-22 松下電器産業株式会社 Display control device and method
US6204887B1 (en) * 1998-12-11 2001-03-20 Hitachi America, Ltd. Methods and apparatus for decoding and displaying multiple images using a common processor
JP4541476B2 (en) * 1999-02-19 2010-09-08 キヤノン株式会社 Multi-image display system and multi-image display method
JP2000324489A (en) * 1999-05-14 2000-11-24 Sony Corp Method and system for transmitting multi-picture video and method for setting-up the transmitting system
JP2002010165A (en) * 2000-06-26 2002-01-11 Sony Corp Multiscreen display and method therefor
KR20020040303A (en) * 2000-11-24 2002-05-30 구자홍 Apparatus for managing PIP of TV
KR20020068134A (en) * 2001-02-20 2002-08-27 엘지전자주식회사 Method for displaying PIP of a digital TV
US6917362B2 (en) * 2002-01-25 2005-07-12 Hewlett-Packard Development Company, L.P. System and method for managing context data in a single logical screen graphics environment
JP2003271285A (en) * 2002-03-12 2003-09-26 Sharp Corp Scroll control apparatus, information processing program, and recording media
JP2003309780A (en) * 2002-04-18 2003-10-31 Matsushita Electric Ind Co Ltd Picture display device
US20050253966A1 (en) * 2002-07-01 2005-11-17 Koninklijke Philips Electronics N.V. System for processing video signals
JP2004133733A (en) * 2002-10-11 2004-04-30 Sony Corp Display device, display method, and program
JP2004178127A (en) * 2002-11-26 2004-06-24 Fuji Xerox Co Ltd Information display processor and program
KR20040071945A (en) * 2003-02-07 2004-08-16 엘지전자 주식회사 Image display device capable of controlling a subpicture and method thereof
US7487460B2 (en) * 2003-03-21 2009-02-03 Microsoft Corporation Interface for presenting data representations in a screen-area inset
KR100512611B1 (en) * 2003-04-11 2005-09-05 엘지전자 주식회사 Method and apparatus for processing PIP of display device
CA2527083C (en) * 2003-06-02 2011-04-26 Disney Enterprises, Inc. System and method of programmatic window control for consumer video players
KR100585534B1 (en) * 2003-08-13 2006-05-30 엘지전자 주식회사 Method and apparatus of tv channel display based on channel grouping using multi-picture
US8260857B2 (en) * 2003-10-23 2012-09-04 Microsoft Corporation One to many data projection system and method
CN2710285Y (en) * 2004-03-01 2005-07-13 天津市华海计算机技术有限公司 Radio transmitted highway traffic video monitoring system
CN100405832C (en) * 2004-12-17 2008-07-23 Tcl王牌电子(深圳)有限公司 TV set apparatus capable of simultaneously receiving and playing multi-channel programs

Also Published As

Publication number Publication date
CN101233749A (en) 2008-07-30
CN101238718A (en) 2008-08-06
CN101238715A (en) 2008-08-06
CN101233747A (en) 2008-07-30
CN101238722A (en) 2008-08-06
CN101238717A (en) 2008-08-06
CN101238717B (en) 2012-09-05
CN101238716A (en) 2008-08-06
CN101233747B (en) 2010-08-04
CN101238719B (en) 2012-05-30
CN101233748B (en) 2011-06-29
CN101238715B (en) 2013-03-27
CN101233750B (en) 2011-11-16
CN101238722B (en) 2011-09-14
CN100581226C (en) 2010-01-13
CN101238718B (en) 2012-05-30
CN101238724A (en) 2008-08-06
CN101233749B (en) 2011-11-16
CN101238720A (en) 2008-08-06
CN101238724B (en) 2012-05-23
CN101233750A (en) 2008-07-30
CN101238721A (en) 2008-08-06
CN101233748A (en) 2008-07-30
CN101238716B (en) 2012-05-23
CN101238721B (en) 2011-06-29

Similar Documents

Publication Publication Date Title
CN101238719B (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens
CN101416489A (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens
KR100725421B1 (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
KR100791301B1 (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
KR100791302B1 (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
MX2008012872A (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens.
EP1911275B1 (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens
KR20070100110A (en) Apparatus for providing multiple screens and method for dynamic configuration of the same
WO2007018370A1 (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens
WO2007114662A1 (en) Apparatus for providing multiple screens and method of dynamically configuring multiple screens

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120530

Termination date: 20190803