CN101416493A - Multiple creens equipment and method - Google Patents
Multiple creens equipment and method Download PDFInfo
- Publication number
- CN101416493A CN101416493A CNA2007800121926A CN200780012192A CN101416493A CN 101416493 A CN101416493 A CN 101416493A CN A2007800121926 A CNA2007800121926 A CN A2007800121926A CN 200780012192 A CN200780012192 A CN 200780012192A CN 101416493 A CN101416493 A CN 101416493A
- Authority
- CN
- China
- Prior art keywords
- screen
- audio content
- service
- output
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The present invention relates to an apparatus and method for providing multiple screens. The apparatus includes a service processing module providing a plurality of services to which a plurality of first audio contents are respectively allocated, a user/application interface module receiving a command to designate one of the first audio contents as a second audio content (where the second audio content is an audio content to be focused), an output module outputting the first audio content that is designated as the second audio content and is focused in response to the received command.
Description
Technical field
The present invention relates to the configuration of multi-screen, more specifically, relating to a kind of dynamic-configuration provides the method for multi-screen of plurality of kinds of contents and the equipment that multi-screen is provided on the single one physical display unit.
Background technology
Traditional broadcast receiver (such as digital TV or top box of digital machine) only provides a content element on the single one physical display unit, or shows main screen and sub-screen on the single one physical display unit simultaneously.
Although the traditional broadcast receiver can show main screen and sub-screen simultaneously on same display screen, can only arrange main screen and sub-screen in the mode of limited quantity.Under the situation of displaying contents, all key elements of displaying contents that is to say in main screen, video data, voice data and other data.On the other hand, in sub-screen under the situation of displaying contents, some key elements of a displaying contents.
Content source comprises: such as satellite broadcasters, terrestrial broadcasting merchant or wired broadcasting merchant's broadcast service, such as the storage medium of DVD or be connected to the external device (ED) of input terminal.Yet it is quite difficult using existing broadcasting receiver to be presented on the display screen by the content that these different content sources provide.
In interactive TV applied environment, suppose and have only a screen to be output to physical display such as multimedia home platform (MHP), senior common application platform (ACAP) and open cable application platform (OCAP).
For example, in interactive TV applied environment, be used based on the user interface (UI) of home audio/video interoperability (HAVi).According to HAVi UI standard, although the screen number that shows on physical display without limits generally only shows a screen on physical display.
Summary of the invention
Technical problem
In such environment, be difficult on content of multimedia being presented at independently screen in, to being presented at the operation of execution a such as decoding in the content of multimedia on the screen, Digital Signal Processing, user interaction process etc.In addition, also being difficult to the screen is the use that unit dynamically controls the life cycle and the resource of application.
Therefore, need method on a kind of screen that plurality of kinds of contents is presented at dynamic-configuration.
Technical scheme
An object of the present invention is to provide a kind of dynamic-configuration that is used on physical display, providing the multi-screen of plurality of kinds of contents.
Another object of the present invention provides a kind of method of selecting independently and the audio content that provides in the various services being provided.
Above and other purpose of the present invention will be described in following preferred embodiment, and perhaps, from the description of following preferred embodiment, above and other purpose of the present invention will become clear.
According to an aspect of the present invention, provide a kind of equipment that is used to provide multi-screen, this equipment comprises: service processing module, the multiple service that provides a plurality of first audio contents to be assigned to respectively; User/AIM receives an order of being appointed as second audio content in described a plurality of first audio contents, and described second audio content is the audio content that will be focused; Output module, in response to the order that receives, first audio content that output is designated as second audio content and is focused.
According to a further aspect in the invention, provide a kind of equipment that is used to provide multi-screen, this equipment comprises: service processing module, the multiple service that provides a plurality of first audio contents to be assigned to respectively; Output module is exported one that is appointed as second audio content in described a plurality of first audio content with reference to the output attribute of first audio content, and described second audio content is the audio content that will be output.
According to a further aspect in the invention, provide a kind of method that multi-screen is provided, this method comprises: the multiple service that provides a plurality of first audio contents to be assigned to respectively; Receive an order of being appointed as second audio content in described a plurality of first audio contents, described second audio content is the audio content that will be focused; In response to the order that receives, first audio content that output is designated as second audio content and is focused.
According to a further aspect in the invention, provide a kind of method that multi-screen is provided, this method comprises: the multiple service that provides a plurality of first audio contents to be assigned to respectively; Output attribute with reference to first audio content is exported one that is appointed as second audio content in described a plurality of first audio content, and described second audio content is the audio content that will be output.
Description of drawings
By the reference accompanying drawing preferred illustrative embodiment of the present invention is described in detail, above-mentioned and other feature and advantage of the present invention will become clearer, wherein:
Fig. 1 to Fig. 8 is the diagrammatic sketch that illustrates according to the configuration of the PiP screen of exemplary embodiment of the present invention;
Fig. 9 illustrates according to the logical screen of exemplary embodiment of the present invention and the diagrammatic sketch of the relation between the display screen;
Figure 10 to Figure 14 is the diagrammatic sketch that illustrates according to the configuration of the screen that comprises mapper (mapper) of exemplary embodiment of the present invention;
Figure 15 is the block diagram that illustrates according to the service source of exemplary embodiment of the present invention;
Figure 16 and Figure 17 illustrate according to the non-abstract service of exemplary embodiment of the present invention and the diagrammatic sketch of abstract service;
Figure 18 is the diagrammatic sketch of example that the type of the attribute information of logical screen and display screen and interface is shown;
Figure 19 is the diagrammatic sketch that the attribute " z-order " according to the logical screen of exemplary embodiment of the present invention is shown;
Figure 20 and Figure 21 are the diagrammatic sketch that illustrates respectively according to the attribute " viewing area " of the logical screen of exemplary embodiment of the present invention;
Figure 22 is the diagrammatic sketch that illustrates according to the method for display screen that two kinds of map of services are arrived of exemplary embodiment of the present invention;
Figure 23 is the block diagram of configuration of equipment that is used to provide multi-screen that illustrates according to exemplary embodiment of the present invention;
Figure 24 is the flow chart that illustrates according to the method for the dynamic-configuration multi-screen of exemplary embodiment of the present invention;
Figure 25 and Figure 26 are that the PiP that illustrates according to exemplary embodiment of the present invention serves the diagrammatic sketch that supplies a pattern;
Figure 27 is the independent flow chart of selecting audio content and exporting the method for the audio content of selecting that illustrates according to exemplary embodiment of the present invention;
Figure 28 is the diagrammatic sketch of example of software architecture that is used to provide multi-screen that illustrates according to exemplary embodiment of the present invention;
Figure 29 is the diagrammatic sketch that illustrates according to the relation between the module of the formation application interface (API) of exemplary embodiment of the present invention layer;
Figure 30 illustrates by as shown in figure 29 module at the flow chart that is presented at the multiple service method that shows on each corresponding logical screen on the display screen;
Figure 31 is the flow chart of the output of audio content according to an embodiment of the invention;
Figure 32 is the flow chart of the output of audio content according to another embodiment of the present invention.
The label of the primary clustering the shown in＜accompanying drawing 〉
900: the equipment that multi-screen is provided
910: the broadcast singal receiver module
920: storage medium
930: outside input module
940: digital signal processing module
950: service processing module
960: output module
965: user/AIM
970: display screen
980: storage medium
990: outside output module
Embodiment
By with reference to following detailed description, can more easily understand advantages and features of the invention and realize method of the present invention preferred embodiments and drawings.But the present invention can realize with many different forms, and should not be construed and be limited to the embodiment that sets forth here.On the contrary, provide these exemplary embodiments so that the disclosure is thorough and complete, and fully pass on design of the present invention to those skilled in the art, the present invention will only be defined by the claims.Run through specification, the identical identical parts of label indication.
Following reference is described the present invention according to the user interface of the embodiment of the invention, the flow chart of method and computer program product.Should be appreciated that each square frame of flow chart and the combination of the square frame in flow chart can be realized by computer program instructions.These computer program instructions can be provided for the processor of all-purpose computer, special-purpose computer or other programmable data processing device with generation equipment, thereby the device of the function that is used for being implemented in a flowchart block or a plurality of flowchart block appointments is created in the instruction carried out of the processor of machine or other programmable data processing device as calculated.
These computer program instructions also can be stored in can instruct computer or other programmable data processing device with the computer of ad hoc fashion work can with or computer-readable memory in so that be stored in computer can with or computer-readable memory in instruction produce the product that comprises execution command device of the function of appointment in a flowchart block or a plurality of flowchart block.
Computer program instructions also can be written into computer or other programmable data processing device so that the sequence of operations step is performed on computer or other programmable devices, producing computer implemented processing, thereby the instruction of carrying out on computer or other programmable devices is provided for being implemented in the step of the function of appointment in a flowchart block or a plurality of flowchart block.
Each square frame of flow chart can represent to comprise module, code segment or the partial code of the executable instruction of one or more realization specific logical function.Be to be further noted that the function of representing in the square frame may take place out of turn in some other implementations.For example, functional according to what relate to, two square frames that show may be carried out in fact substantially simultaneously continuously, carry out with opposite order when perhaps having.
In order to understand the present invention better, will define the term that uses in the disclosure now.
One group of content of multimedia that is shown together of term " service " indication that is to say one group of service component.
Service component is the key element of service, and service component comprises video component, audio component and data component.Data component is the application in the service.
Use (application) and can be divided into not binding (unbound) application and service binding (bound) application.Binding is not used with specific channel and is had nothing to do, therefore, and the influence that the execution of this application is not switched by channel.In addition, unbound application has high priority usually, and therefore, the resource that is used to carry out this application is distributed to this application smoothly.Monitor is used corresponding to a unbound application in the specific unbound application that can have limit priority.
Simultaneously, service binding is used relevant with transport stream, and has the priority that is lower than unbound application usually.Service binding is used and is not carried out any critical system function., when resource contention takes place, compare with unbound application, the possibility that service binding is used the relinquishes resources distribution is bigger for this reason.Service binding is used and can be divided into and the link type of the current stream cooperating operation that just is being transmitted and the non-link type that has nothing to do with the current stream that just is being transmitted.
The object of the execution of term " service context " indication may command service, and various resources, device and the execution state information that provides service required is provided.
In fact term " physical display " indication shows the physical space of the content of service, the external output port of exporting the content of serving or the storage device of stores service.
In fact term " display screen " indication is presented at the screen on the physical display.Any service can directly be set in display screen, and display screen can be presented on the physical display.Perhaps, at least one logical screen that is mapped to the specific region of display screen can be presented on the physical display.
Term " logical screen " indicated number is the space of service arbitrarily.Logical screen was virtual screen before being mapped to display screen, so logical screen is not displayed on the physical display.
Logical screen and display screen can be the combinations of stationary background image, video raster and figure grating.The figure grating can be the combination of literal, lines, color and image, or the mixing of frame of video.
Term " master's service " the such service of indication, this service is served by being presented at menu or the remote controller on the physical display or being chosen to be the master by application by API by the user, and shows that main screen of serving is called as " main screen ".
The service that term " picture in picture service " (PiP service) indication is such, by being presented at menu on the physical display or remote controller or being chosen to be sub-services in the main service by using by API, and the PiP service can be displayed on picture-in-picture screen (PiP screen) or the main screen by the user in this service.
The PiP screen comprise a part of occupying another screen as shown in Figures 1 to 4 screen and as Fig. 5 to shown in Figure 6 show simultaneously with another screen and with the nonoverlapping screen of this another screen.In this case, should be appreciated that, as shown in Figure 7 and Figure 8, the PiP screen can comprise that the optional position that is displayed in the physical display or zone are gone up or with the screen of another screen overlay.
Fig. 9 illustrates according to the logical screen of exemplary embodiment of the present invention and the diagrammatic sketch of the relation between the display screen.
With reference to Fig. 9, can use logical screen 210,212 and 214 to show service.By mapping block 230 logical screen 210,212 and 214 is mapped to display screen 220,222 and 224.
At length, logical screen 210 and 212 is mapped to display screen 220, logical screen 212 and 214 is mapped to display screen 222, logical screen 210,212 and 214 is mapped to display screen 224.
In brief, be used to show that at least one logical screen of service is mapped to the arbitrary region of display screen.
With reference to Figure 10, will comprise that by mapper the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain with standard size.Be mapped to the entire display screen curtain with the size of dwindling by the PiP screen that mapper will include only video component.In this case, on main screen, this comes definite according to Z value with the PiP screen display of mapping.Reference character Z is meant after a while with the z-sequence valve of describing.Overlapping screen can combine with display screen.Overlapping screen is to be arranged in outermost specific screens, can use overlapping screen when caption function is provided.The PiP screen may only have video component as shown in figure 10, also may have the combination of stationary background image B, video raster V and figure grating G as shown in figure 11.
With reference to Figure 12, will comprise that by mapper the main screen of the combination of stationary background image B, video raster V and figure grating G is mapped to the entire display screen curtain with standard size.To only have two PiP screen # 1 of video component and the arbitrary region that #2 is mapped to display screen with the size of dwindling by mapper.In this case, the PiP screen of mapping is disposed on the main screen, and can keep the Z value consistently.In addition, overlapping screen can combine with display screen.The configuration of screen can have a plurality of PiP screens that include only video component as shown in figure 12, or has a plurality of PiP screens of the combination that comprises stationary background image B, video raster V and figure grating G.
The POP screen as shown in figure 14.Be appreciated that known PiP screen display in main screen, and the POP screen display is outside main screen.With reference to Figure 14, will comprise a plurality of PiP screen # 1 of combination of stationary background image B, video raster V and figure grating G and the arbitrary region that #2 is mapped to display screen by mapper with the size of dwindling.In this case, can keep the POP screen # 1 that shines upon and the Z value of #2 consistently.In addition, overlapping screen can combine with display screen.
Can realize mapping block 230 by interface or the function worked out by various computer programming languages, and mapping block 230 can be by using above-mentioned information as the relation between parameter establishment or change logical screen and the display screen with being performed.
Perhaps, can realize mapping block 230 by the hardware of the mapping function between actuating logic screen and the display screen.
In addition, as shown in figure 15, the service that is provided by various services source can be presented on the display screen, described display screen is displayed on the physical display.
There is following multiple service source: such as terrestrial broadcasting merchant 320 and wired broadcasting merchant's 330 the service source that broadcast service is provided, such as the service source that the service that is stored in the storage medium is provided of individual video recorder (PVR) 340 with the service source (showing among Figure 15) of service is provided via cable network or wireless network.
Then, use predefined method or any service directly is set on the display screen that will be displayed on the physical display by user or the method that use to be provided with.Otherwise, at least one logical screen that is mapped to the arbitrary region of display screen is presented on the physical display 350.In brief, the service that terrestrial broadcasting merchant 320, wired broadcasting merchant 330 and PVR are provided is presented on the physical display 350.
As Figure 16 and shown in Figure 17, service can be divided into abstract service and non-abstract service according to an exemplary embodiment of the present invention.
Abstract service is the service that is independent of broadcasting channel, rather than the service that is provided by the broadcast singal of real-time transmission.Abstract service includes only data component, that is to say, uses, and does not comprise video component and audio component.The example of abstract service comprises the service with unbound application based on open cable application platform (OCAP) standard.
Non-abstract service is understood that to be different from the service of abstract service.
According to current exemplary embodiment of the present invention, abstract service and non-abstract service all have independence.For example, can abstract service directly be set on physical display, and can on logical screen, show non-abstract service by logical screen.Then, logical screen can be mapped to the display screen that is provided with abstract service.After this, can pass through physical display output display screen curtain.Like this, abstract service can be independent of non-abstract service and is displayed on the display screen.In addition, abstract service can be mapped to different logical screens with non-abstract service.After this, logical screen can be mapped to the single display screen.In other words, abstract service can be independent of non-abstract service and is displayed on the display screen.
According to current embodiment of the present invention, logical screen can be classified as different objects with display screen.Perhaps, according to the attribute information of a screen object, screen can be used as logical screen or display screen.
At length, according to the type information of the attribute information of screen object as can be known screen object be logical screen or display screen.
The attribute information of screen object comprises a plurality of attributes " type ", " z-order ", " viewing area ", " observability ", " relevant display screen ", " related service context ", " interrelated logic screen " and " output port ".
Figure 18 illustrates the type of the interface of the attribute information of screen object and processing attribute information.
Attribute " type " 510 expression screen types are logical screen or display screen.
Attribute " z-order " 520 is used for determining to arrange a plurality of logical screens along the z axle in what order.Figure 19 illustrates the difference configuration of the logical screen on the physical display of various combination of value of attribute for logical screen " z-order ".
With reference to Figure 19, respectively first logical screen 620 and second logical screen 630 are mapped to the presumptive area of display screen 610.At length, first logical screen 620 is displayed on the display screen 610, and second logical screen 630 and first logical screen 620 are presented on the display screen with overlapping.In other words, sequentially arrange display screen 610, first logical screen 620 and second logical screen 630 along the z direction of principal axis.In this case, the attribute " z-order " that the attribute of first logical screen 620 " z-order " can the value of being set to 1, the second logical screen 630 can the value of being set to 2.The attribute of first logical screen 620 and second logical screen 630 " z-order " can be set to Any Digit or character, as long as they can represent the particular order of arranging first logical screen 620 and second logical screen 630 along the z axle.
As Figure 20 and shown in Figure 21, attribute " viewing area " the 530th is about the information in the display screen zone of logical screen.
Figure 20 illustrates the whole zone that logical screen 710 is mapped to display screen 720, and Figure 21 illustrates the subregion that logical screen 730 is mapped to display screen 740.
Attribute " viewing area " can comprise specifies the information of logical screen with the two-dimensional coordinate of the predetermined portions of the display screen that is mapped to, can comprise that perhaps what deviant the information and the indication logical screen of specifying the precalculated position on the display screen have departed from from the precalculated position on the display screen.
Attribute " observability " 540 determine with logical screen visibly (visibly) still invisibly (invisibly) be presented on the display screen.By changing the value of attribute " observability " 540, logical screen is appeared on the display screen or from display screen disappear.
Attribute " relevant display screen " the 550th is about the information of the display screen relevant with logical screen.The logical screen that all has nothing to do with any display screen may not be displayed on the physical display, also is not sent to outside output device.
Attribute " related service context " the 560th is about the information of the service context that is connected to logical screen or display screen.The service that is arranged in such service context can be displayed on logical screen or the display screen.
Attribute " output port " the 570th, about the information with the device of output display screen curtain, this device comprises display screen, wire/wireless communication medium and various storage medium.
Can be provided for discerning or changing the interface of the value of attribute as shown in figure 18.With reference to Figure 18, this interface can comprise: interface " setting " sets property or logical screen is connected to display screen; Interface " interpolation " adds property value or logical screen is connected to service; Interface " obtains ", the recognition property value; And interface " removal ", the delete property value.These interfaces can comprise process, function, program or the method for carrying out its function respectively.
For example, method " getDisplayScreen (void) " is returned the display screen relevant with current screen.At length, if current screen is a logical screen, then method " getDisplayScreen (void) " is returned relevant display screen.If current screen is a display screen, then method " getDisplayScreen (void) " is returned the reference information about current screen.In addition, if current screen is a logical screen, but do not have relevant screen, then method " getDisplayScreen (void) " is returned " sky " value.
According to another example, method " public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException " provides the function that current logical screen is mapped to the presumptive area of relevant display screen.The example that provides as parameter is the class " HScreenRectangle " of bag " org.havi.ui ", and this example has two-dimensional position information.The abnormal operation that method " SecurityException " and " IllegalStateException " can be used as method " setDisplayScreen (HScreen screen) " is performed.When current screen is logical screen, or when the part of the display screen relevant with current logical screen can not change owing to the characteristic of host platform, executing method " IllegalStateException ".
According to another example, method " getOutputArea (void) " is returned the area information of current screen as HScreenRectangle information.If current screen is corresponding to display screen, then method " getOutputArea (void) " is returned the identical HScreenRectangle information of value that has with HScreenRectangle (0,0,1,1).If current screen is a logical screen, then method " getOutputArea (void) " is returned the information about the zone on the display screen that is occupied by current screen.If current screen is a logical screen, but all have nothing to do with any display screen, then method " getOutputArea (void) " is returned " sky " value.
Run through following description, some term is used with the expression special interface.Yet the name that it should be appreciated by those skilled in the art that specific function is just in order to indicate its function.Presents is not the different function of not function in order to distinguish the title difference.
Figure 22 is illustrated in the diagrammatic sketch that the processing of two kinds of services is set with being mapped on two logical screens of single display screen.
With reference to Figure 22, first service comprises three kinds of all service component, that is to say, and video component, audio component and data component, second service only comprises video component and audio component.Yet the present invention does not apply any restriction to service component, and as shown in Figure 8 first service and second service are exemplary.
As shown in figure 22, in mode mode much at one first service and second service are presented on the physical display with prior art.According to current embodiment of the present invention, multiple service can be presented on the physical display independently of one another, and the quantity that can be presented at the service on the single display screen not applied any restriction.
Figure 23 is the block diagram of equipment that is used to provide multi-screen according to exemplary embodiment of the present invention.
With reference to Figure 23, be used to provide the equipment 900 of multi-screen to comprise digital signal processing module 940, service processing module 950, output module 960 and user/AIM 965.
In addition, equipment 900 comprises broadcast singal receiver module 910, storage medium 920 and outside input module 930 as the service source, and comprises that physical display 970, storage medium 980 and outside output module 990 are as the service output medium.
Here the term of Shi Yonging " module " is meant the software or the nextport hardware component NextPort of (but being not limited to) execution particular task, such as field programmable gate array (FPGA) or application-specific integrated circuit (ASIC) (ASIC).Module can advantageously be configured to reside on addressable storage medium and be configured to and be carried out on one or more processor.Thereby, as example, module can comprise assembly, process, function, attribute, program, subprogram, program code segments, driver, firmware, microcode, circuit, data, database, data structure, table, array and the variable such as component software, OO component software, class component and task component.The function that provides in these assemblies and module can be combined into assembly and module still less, perhaps further is separated into other assembly and module.
Digital signal processing module 940 receives the various information (for example, video information, audio-frequency information or data message) of service (such as content of multimedia) from broadcast singal receiver module 910, storage medium 920 or outside input module 930.
Broadcast singal receiver module 910 receives satellite, ground or cable broadcasting signal, and the broadcast singal of transmission reception, video information, audio-frequency information or the data message of storage medium 920 stores service, outside input module 930 is from receiving video information, audio-frequency information or the data message of service such as the external device (ED) that is connected to the network of network interface module.
Digital signal processing module 940 uses the service component that receives to recover multiple service.The service that recovers comprises abstract service or non-abstract service.
Here, " multiple service " is meant two or more services that sent by broadcast singal receiver module 910, or two or more services that sent by broadcast singal receiver module 910 and storage medium 920 respectively.
Digital signal processing module 940 can recover to serve according to user or the selection of using by means of user/AIM 965.In this case, user or use can select being connected between service arbitrarily and the screen.
Service processing module 950 produces logical screen and display screen, to show the service that is recovered by digital signal processing unit 940.
Output module 960 will be mapped to display screen by a plurality of logical screens that service processing module 950 produces.The method that can use predefined method or user to be provided with by means of user/AIM 965 is handled the mapping from the logical screen to the display screen.
Can can't help screen processing module 950 and handle the service that recovers by digital signal processing module 940.On the contrary, the service that is recovered by digital signal processing module 940 can directly be mapped to the specific part of the display screen that is generated by output module 960.
The display screen that is provided by output module 960 can be presented on the physical display 970, maybe can be stored in the storage medium 980.The example of storage medium 980 comprises computer-readable floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, BD (Blu-ray Disc) and semiconductor memory.
In addition, can will send to the external device (ED) that is connected to network by the display screen that output module 960 provides via outside output module 990.
For this reason, output module 960 can comprise a plurality of output ports, can provide display screen via described a plurality of output ports.In this case, can provide display screen via setting in advance to the output port of acquiescence or the output port of selecting by means of user/AIM 965 by the user.
User or application can use user/AIM 965 to select the service of a kind of or recovery expectation in the multiple service.In addition, the user can use user/AIM 965 to select in a plurality of display screens one.
Because module shown in Figure 23 is divided according to its function, therefore can be connected to other modules.
Figure 24 is the flow chart that illustrates according to the method for the dynamic-configuration multi-screen of exemplary embodiment of the present invention.
Usually, send video information, audio-frequency information and the data message that constitutes content of multimedia with predetermined form (for example, mpeg stream form).In operation S1010, be used to provide equipment receiver, video information, audio-frequency information and data message, and recover service based on the video information that receives, audio-frequency information and data message such as the service of content of multimedia service.Here, can or pre-determine the service that in operation S1010, recovers by user or application choice.The user can use at the menu that shows on the display unit or remote controller and select connection between any screen and the screen.Application can use API to select described connection.
In addition, data message comprises the application message about the application that is used to serve, and this application message comprises the signal message whether the indication application program can be carried out on the PiP screen.The example of application message comprises based on the application information table of MHP standard (AIT) with based on the expanded application information table (XAIT) of OCAP standard.Signal message can be added to application message.
After this, in operation S1020, the service that recovery is set makes it and can be presented on the logical screen.In operation S1030, logical screen is mapped to display screen.In operation S1040, use display screen, storage medium or network that display screen is offered the user.
The service of recovery as shown in figure 24 is displayed on the physical display via logical screen.Yet the service of recovery can directly be presented on the physical display, and need not through logical screen.
For the sake of simplicity, Figure 24 illustrates only with the method for a kind of map of services to display screen.Yet, can by or multiple map of services is not arrived display screen by a plurality of logical screens.When by this way display screen being offered the user, the user can carry out multiple service.
When user or application choice PiP service, provide the equipment 900 of multi-screen to provide the PiP of two kinds of patterns to serve.Figure 25 illustrates first pattern of two kinds of patterns, and Figure 26 illustrates second pattern of two kinds of patterns.
With reference to Figure 25, in first pattern, need not to create the independent logical screen that is used for the PiP service, that is to say the PiP screen, the video component that the PiP that only is provided for selecting on main screen serves.In first pattern, do not carry out and the relevant any application of PiP service, or the operation failure of the application relevant with the PiP service.
With reference to Figure 26, in second pattern, create the PiP service of independent logical screen that is used for the PiP service to select on the PiP screen that is provided at establishment.The PiP screen that provides in second pattern comprises the background video or the video component of screen as a setting.In addition, in second pattern, can carry out and the relevant application of PiP service.Can determine whether based on above-mentioned signal message to carry out and the relevant application of PiP service.
Preferably, can not carry out first pattern and second pattern simultaneously.
Can or use by the input of user/AIM 965 and select the PiP service to supply a pattern by the user.When user or application choice first pattern, the video component that the PiP that 940 of digital signal processing modules recover to select serves.The video section that recovers is mapped to the main screen that is produced by service processing module 950, is shown to then on the screen of output module 960 generations.When user or application choice second pattern, the PiP that digital signal processing module 940 recovers to select serves.The service that recovers is mapped on the PiP screen of being created by service processing module 950, is displayed on then on the screen of output module 960 generations.
User or the audio content of the specific a kind of service in the multiple service that can select to provide on the logical screens by user/AIM 965 is provided, and the output of the audio content of selection is exported independently.This is handled as shown in figure 27.
At first, user or application are selected special services (S1310) by user/application module 965.
Then, digital signal processing module 940 extracts audio content from the service of selecting, and the audio content of extraction is mapped on logical screen that service processing module 950 produces or the display screen and by output module 960 and outputs to corresponding screen (S1320) independently.Here, " independent output " is understood to the notion that (for example) comprises following content: the audio content of special services is selected and be sent out by the output port that is mapped on the display screen, and display screen the audio content of special services and other services that provide on a screen is provided simultaneously or only shows special services." independent output " also is understood to the audio content of exporting, provide or store multiple service by different medium respectively.In other words, audio content needn't provide with other components of service of the same race, and user or application can independently provide audio content.
Output module 960 is by user or application choice, and output module 960 is by predetermined outside output module 990 output audio contents.
When multiple audio content is selected, can export each audio content simultaneously independently by independent outside output module 990.
User or application can be independent of the audio content of other components of same services by the 965 selection hope of user/application module.
Figure 28 is the diagrammatic sketch of software architecture that is used to provide multi-screen that illustrates according to exemplary embodiment of the present invention.
With reference to Figure 28, software architecture 1400 comprises device Drive Layer 1410, application interface (API) layer 1420 and application layer 1430.
User interface is provided application layer 1430 so that the user can dynamic-configuration show the logical screen of serving, or user command is sent to api layer 1420 so that api layer 1420 can be carried out user command.
The user makes device Drive Layer 1410 provide display screen maybe display screen can be stored in the storage medium via physical display by means of application layer 1430.In addition, the user can make device Drive Layer 1410 display screen be sent to external device (ED) through network.
For this reason, device Drive Layer 1410 can comprise a plurality of output ports that display screen can be provided.Otherwise api layer 1420 can comprise a plurality of output ports.
For a plurality of logical screens of dynamic-configuration on display screen, api layer 1420 can comprise a plurality of software modules, for example, as shown in figure 29, multi-screen manager module " MultiScreenManager ", multi-screen context module " MultiScreenContext ", multi-screen context monitor module " MultiScreenContextListener ", and multi-screen context events module " MultiScreenContextEvent ".
Multi-screen manager module 1510 management multi-screen context module 1530, the screen of search expectation, show to be used to specify which device registration multi-screen context monitor module 1550, or the registration of cancellation screen context monitor module 1550 by the information of Screen sharing.
Multi-screen context module 1530 is interface object relevant with screen object 1520, and multi-screen context module 1530 determines that according to the interface operation of being carried out by multi-screen context module 1530 screen object 1520 becomes logical screen or display screen.Various attributes as shown in Figure 18 can be set in multi-screen context module 1530.Multi-screen context module 1530 can provide function " setting ", " interpolation ", " obtaining " and " removal " as described in Figure 18.
When multi-screen context module 1530 changes the attribute information of screen object 1520, multi-screen context events module 1540 is as the reformed event class of attribute information of notification screen object 1520, multi-screen context monitor module 1550 is as the monitor interface object, described monitor interface object can realize with predetermined application class, and described predetermined application class attempts to receive the incident by 1540 promptings of multi-screen context events module.
Using 1560 is driven modules on application layer 1430.Using 1560 allows the user to select the service of expecting and freely arrange a plurality of logical screens on display screen.
At length, use 1560 and will allow the various command of user's dynamic-configuration and management logic screen to send to multi-screen manager module 1510, multi-screen manager module 1510 is performed by 1530 controls of multi-screen context module and the corresponding operation of described various command.
Multi-screen context module 1530 is relevant with screen object 1520, and the attribute information of the screen object 1520 shown in management Figure 18.For the attribute information of management screen object 1520, multi-screen context module 1530 can comprise multiple function or method.
Multi-screen manager module 1510 can receive the service component that is provided by various services source from device Drive Layer 1410, and the service component that can operate receiving is presented on logical screen or the display screen.Can carry out this function by unshowned independent module.
Figure 30 illustrates to pass through as shown in figure 29 module at the flow chart that is presented at the multiple service method that shows on each corresponding logical screen on the display screen according to exemplary embodiment of the present invention.
With reference to Figure 30, in operation S1610, multi-screen manager module 1510 produce display screens and with the corresponding a plurality of logical screens of the quantity of the service that will be performed.
In operation S1620, multi-screen manager module 1510 is connected to logical screen from the service of each correspondence of device Drive Layer 1410 receptions.Multi-screen manager module 1510 can be set to the parameter of logical screen service by the service context object of the service that receives and come each logical screen call method " addServiceContext ".Method " addServiceContext " is connected to service with logical screen, and can be provided by multi-screen context module 1530.
In operation S1630, in case logical screen is connected to each service, multi-screen manager module 1510 just is connected to display screen with logical screen.At this moment, multi-screen manager module 1510 can be set to parameter and comes each logical screen call method " setDisplayScreen " by the display screen object that logical screen is connected to.Method " setDisplayScreen " is connected to display screen with logical screen, and can be provided by multi-screen context module 1530.
Method " setDisplayScreensetDisplayScreen " can be set to " public voidsetDisplay Screen (HScreen screen) throws SecurityException; IllegalStateException ", the example " HScreen " that this method permission is provided as parameter is relevant with current logical screen.In this case, example " HScreen " display screen preferably.
The parameter of method " setDisplayScreen (HScreen screen) " can comprise " sky " value.In this case, when need not abnormality processing when manner of execution " setDisplayScreen (HScreen screen) ", current logical screen is no longer relevant with display screen.
The execution of method " SecurityException " and " IllegalStateException " can be understood that the abnormal operation of method " setDisplayScreen (HScreen screen) ".
When current screen is logical screen or when the part of the display screen relevant with current logical screen can not change owing to the characteristic of host platform, executing method " IllegalStateException ".
In operation S1640, determine that logical screen is with the zone on the display screen that is mapped to respectively.At this moment, can call the predetermined method that provides by multi-screen context module 1530, to determine with the zone on the display screen of display logic screen.
Figure 31 is the flow chart that illustrates according to the output of exemplary audio content of the present invention.Service processing module 950 can be represented multiple service, distributes to the audio content of every kind of service and can or use focusing by the user.
That is to say, but user or application input command will be scheduled to be appointed as the focusing target.Then, in operation 1710, user/AIM 965 receives the user or uses the order of input.
For predetermined audio content is appointed as the focusing target, can call method " assignAudioFocus ".Method " assignAudioFocus " is the method that one of a plurality of audio contents are focused, and can provide this method by multi-screen context module 1530.
In case finish audio content is appointed as the focusing target, output module 960 just output is designated as the audio content (S1730) that focuses on target and be focused.More particularly, output module 960 can check which audio content in a plurality of audio contents of distributing to multiple service respectively is designated as focusing target (S1720), is designated as the audio content (S1730) that focuses on target according to result's output of checking then.
To be designated as the audio content that focuses on target in order checking, can to call method " getAudioFocus ".Method " getAudioFocus " is to check the method for the current audio content that just is being focused, and the object that this method will have the type identical with the type of the class " HScreen " of wrapping " org.havi.ui " returns as the result who checks.That is to say that method " getAudioFocus " is returned the screen that expression comprises the service of the current audio content that just is being focused, the audio content that output module 960 output screens are represented.
Figure 32 is the flow chart that illustrates according to the output of another exemplary audio content of the present invention.Output module 960 can be exported a plurality of audio contents simultaneously.More particularly, with reference to Figure 32, output module 960 is checked the attribute (S1810) of each audio content in a plurality of audio contents of distributing to multiple service respectively, and output is designated as the audio content (S1820) of export target.
Output module 960 can be exported the audio content that is designated as export target with the current audio content that just is being focused.For example, suppose that audio content A, B, C and D are assigned to various corresponding services, and audio content A is current just is focused.If audio content B is set to and can not exports with other audio contents simultaneously, and audio content C and D be set to and can export with other audio contents simultaneously, and then output module 960 can be exported audio content A simultaneously with audio content C and D.
Audio content B can be output when being focused on by user or application.
That is to say that output module 960 can be exported the audio content that is designated as export target with reference to the output attribute of a plurality of audio contents of distributing to multiple service respectively.Here, can or use the output attribute that uses user/AIM 965 that audio content is set by the user.
For the attribute of a plurality of audio contents is set, can call method " addAudioSources ".Method " addAudioSources " can be set to and can be output simultaneously by a plurality of audio contents.
The parameter of method " addAudioSources " can comprise matrix " device " and the Boolean denotation " mixWithAudioFocus " with type identical with the type of the class " HScreenDevice[] " of bag " org.havi.ui ".Can determine whether a plurality of audio contents can be output simultaneously based on the value of Boolean denotation " mixWithAudioFocus ".
That is to say, but the device that user or application using method " addAudioSources " select at least one device that audio content is connected to and audio content to be set to be output to simultaneously with other audio contents selection.For example, if the Boolean denotation " mixWithAudioFocus " of method " addAudioSources " is set to 1, then the audio content of the device of Xuan Zeing can be output simultaneously with the current audio content that just is being focused.On the other hand, if the Boolean denotation " mixWithAudioFocus " of method " addAudioSources " is set to 0, then the audio content of the device of Xuan Zeing can not be output simultaneously with the current audio content that just is being focused.In this case, the audio content of the device of selection only is output being focused Shi Caike.
Output was provided with when user or use can cancel the audio content that is set to be output simultaneously with another audio content.For this reason, can call method " removeAudioSources ".Method " removeAudioSources " can comprise that the matrix " device " with type identical with the type of the class " HScreenDevice[] " of bag " org.havi.ui " is as parameter.When method " removeAudioSources " when being called, output setting is cancelled in the time of the audio content of at least one device of matrix " device " appointment of method " removeAudioSources ".Method " removeAudioSources " can not comprise any parameter.In this case, the audio content of all devices time output setting can be cancelled.
Although specifically illustrate and described the present invention with reference to exemplary embodiment of the present invention, but will be understood by those skilled in the art that, under the situation that does not break away from the spirit and scope of the present invention that are defined by the claims, can carry out various changes in form and details.Therefore, should be appreciated that above-mentioned exemplary embodiment is a purpose of description, should not be understood that any restriction scope of the present invention.
Utilizability on the industry
According to the present invention, can use the single physical display screen carry out in every way each provenance (as, have Line broadcasting, terrestrial broadcasting, various storage medium and outside input) many services that provides.
Claims (16)
1, a kind of equipment that is used to provide multi-screen, described equipment comprises:
Service processing module, the multiple service that provides a plurality of first audio contents to be assigned to respectively;
User/AIM receives an order of being appointed as second audio content in described a plurality of first audio contents, and described second audio content is the audio content that will be focused;
Output module, in response to the order that receives, first audio content that output is designated as second audio content and is focused.
2, equipment as claimed in claim 1, wherein, the output module inspection is designated as first audio content of second audio content, and is designated as first audio content of second audio content according to result's output of checking.
3, equipment as claimed in claim 1, wherein, output module also will be scheduled to first audio content simultaneously with reference to the attribute of first audio content and export with first audio content that is designated as second audio content except output is designated as first audio content of second audio content.
4, equipment as claimed in claim 1 wherein, is appointed as second audio content by user or application with one in described a plurality of first audio contents.
5, a kind of equipment that is used to provide multi-screen, described equipment comprises:
Service processing module, the multiple service that provides a plurality of first audio contents to be assigned to respectively;
Output module is exported one that is appointed as second audio content in described a plurality of first audio content with reference to the output attribute of first audio content, and described second audio content is the audio content that will be output.
6, equipment as claimed in claim 5, wherein, output module is exported current one first audio content that just is being focused in described a plurality of first audio content.
7, equipment as claimed in claim 6, wherein, first audio content and the current audio content that just is being focused that are designated as second audio content are output simultaneously.
8, equipment as claimed in claim 5 also comprises: user/AIM is provided with the output attribute of first audio content.
9, a kind of method that multi-screen is provided, described method comprises:
The multiple service that provides a plurality of first audio contents to be assigned to respectively;
Receive an order of being appointed as second audio content in described a plurality of first audio contents, described second audio content is the audio content that will be focused;
In response to the order that receives, first audio content that output is designated as second audio content and is focused.
10, method as claimed in claim 9 also comprises: check first audio content that is designated as second audio content.
11, method as claimed in claim 9, wherein, the step of output comprises: except output is designated as first audio content of second audio content, also will be scheduled to first audio content with reference to the attribute of first audio content and exports simultaneously with first audio content that is designated as second audio content.
12, method as claimed in claim 9 wherein, is appointed as second audio content by user or application with one in described a plurality of first audio contents.
13, a kind of method that multi-screen is provided, described method comprises:
The multiple service that provides a plurality of first audio contents to be assigned to respectively;
Output attribute with reference to first audio content is exported one that is appointed as second audio content in described a plurality of first audio content, and described second audio content is the audio content that will be output.
14, method as claimed in claim 13, wherein, the step of output comprises: export current one first audio content that just is being focused in described a plurality of first audio content.
15, method as claimed in claim 14, wherein, the step of output also comprises: first audio content and the current audio content that just is being focused that will be designated as second audio content are exported simultaneously.
16, method as claimed in claim 13 also comprises: the output attribute that first audio content is set.
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US78957706P | 2006-04-06 | 2006-04-06 | |
| US60/789,577 | 2006-04-06 | ||
| US60/812,090 | 2006-06-09 | ||
| US60/870,471 | 2006-12-18 | ||
| US60/918,894 | 2007-03-20 | ||
| KR1020070033459 | 2007-04-04 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101416493A true CN101416493A (en) | 2009-04-22 |
Family
ID=40595676
Family Applications (11)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
| CNA2007800121926A Pending CN101416493A (en) | 2006-04-06 | 2007-04-05 | Multiple creens equipment and method |
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120942A Pending CN101416490A (en) | 2006-04-06 | 2007-04-04 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121837A Pending CN101416492A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method for dynamic configuration of the same |
Family Applications After (8)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800120317A Pending CN101416489A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800122149A Pending CN101416494A (en) | 2006-04-06 | 2007-04-05 | Apparatus and method for identifying an application in the multiple screens environment |
| CNA2007800121146A Pending CN101416491A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124017A Pending CN101416496A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800123118A Pending CN101416495A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120213A Pending CN101416488A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800124144A Pending CN101416497A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
| CNA2007800120143A Pending CN101416487A (en) | 2006-04-06 | 2007-04-05 | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Country Status (1)
| Country | Link |
|---|---|
| CN (11) | CN101416490A (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101763842B (en) * | 2009-11-13 | 2012-07-11 | 广东威创视讯科技股份有限公司 | Spliced wall body allocation system and position mapping method for establishing display units |
| KR101743776B1 (en) | 2010-09-28 | 2017-06-05 | 엘지전자 주식회사 | Display apparatus, method thereof and method for transmitting multimedia |
| CN103176684B (en) | 2011-12-22 | 2016-09-07 | 中兴通讯股份有限公司 | A kind of method and device of multizone interface switching |
| US9632648B2 (en) | 2012-07-06 | 2017-04-25 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
| CN103631551A (en) * | 2012-08-27 | 2014-03-12 | 深圳市蓝韵网络有限公司 | Local display method for remote desktop in medical consultation system |
| KR102069547B1 (en) * | 2013-04-19 | 2020-01-28 | 삼성전자주식회사 | Method and apparatus for transmitting and receiving additional information in a broadcast communication system |
| US20180012570A1 (en) * | 2016-07-07 | 2018-01-11 | Futurewei Technologies, Inc. | Apparatus and method for mapping frame buffers to logical displays |
| CN111045622B (en) * | 2019-11-21 | 2023-06-30 | 中国航空工业集团公司西安航空计算技术研究所 | Object-oriented display control interface model |
-
2007
- 2007-04-04 CN CNA2007800120942A patent/CN101416490A/en active Pending
- 2007-04-05 CN CNA2007800121837A patent/CN101416492A/en active Pending
- 2007-04-05 CN CNA2007800121926A patent/CN101416493A/en active Pending
- 2007-04-05 CN CNA2007800120317A patent/CN101416489A/en active Pending
- 2007-04-05 CN CNA2007800122149A patent/CN101416494A/en active Pending
- 2007-04-05 CN CNA2007800121146A patent/CN101416491A/en active Pending
- 2007-04-05 CN CNA2007800124017A patent/CN101416496A/en active Pending
- 2007-04-05 CN CNA2007800123118A patent/CN101416495A/en active Pending
- 2007-04-05 CN CNA2007800120213A patent/CN101416488A/en active Pending
- 2007-04-05 CN CNA2007800124144A patent/CN101416497A/en active Pending
- 2007-04-05 CN CNA2007800120143A patent/CN101416487A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| CN101416491A (en) | 2009-04-22 |
| CN101416496A (en) | 2009-04-22 |
| CN101416494A (en) | 2009-04-22 |
| CN101416495A (en) | 2009-04-22 |
| CN101416489A (en) | 2009-04-22 |
| CN101416487A (en) | 2009-04-22 |
| CN101416497A (en) | 2009-04-22 |
| CN101416488A (en) | 2009-04-22 |
| CN101416492A (en) | 2009-04-22 |
| CN101416490A (en) | 2009-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101238716B (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| US8046709B2 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| CN101416493A (en) | Multiple creens equipment and method | |
| WO2007018369A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| CA2648960A1 (en) | Apparatus and method for identifying an application in the multiple screens environment | |
| EP1911275B1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| WO2007114669A1 (en) | Apparatus and method for identifying an application in the multiple screens environment | |
| CA2615881A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| WO2007018380A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| WO2007018379A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| WO2007114666A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens | |
| EP1911271A1 (en) | Apparatus for providing multiple screens and method of dynamically configuring multiple screens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |