KR100888595B1 - Apparatus for providing multiple screens and method for dynamic configuration of the same - Google Patents

Abstract

The present invention relates to an apparatus for providing multiple screens and a method for dynamically configuring the multiple screens. The present invention relates to a form and connection of screens existing in a device for dynamically configuring a plurality of screens representing a plurality of services on a physical display screen. An apparatus for providing multiple screens for discovering relationships and a method for dynamic configuration of the multiple screens.

An apparatus for providing multiple screens according to an embodiment of the present invention is an operation module for generating at least one or more screens for representing a received service, and a search for searching for a screen on which a predetermined application included in the service is executed among the screens. Contains modules

Multi Screen, Logic Screen, Output Screen, Application, Search

Description

Apparatus for providing multiple screens and method for dynamic configuration of the same}

1 is an exemplary view illustrating a form of arranging a main screen and a sub screen in a physical display screen according to the related art.

2 is an exemplary view showing a relationship between a logic screen and an output screen according to an embodiment of the present invention.

3A to 3E are diagrams illustrating the configuration of a screen including a mapper according to an embodiment of the present invention.

4 is an exemplary diagram illustrating an example of a source for providing a service according to an embodiment of the present invention.

5A and 5B are exemplary diagrams illustrating examples of abstract services and non-abstract services according to an embodiment of the present invention.

6 is an exemplary diagram illustrating attribute information and interface types in a logical screen and an output screen.

7 is an exemplary diagram illustrating a 'z-order' attribute of a logical screen.

8A and 8B are exemplary diagrams illustrating the property 'Display_Area' of a logical screen.

9 is an exemplary diagram illustrating a process in which two services are mapped and output on one output screen.

10 is a block diagram showing the configuration of an apparatus for providing multiple screens according to an embodiment of the present invention.

11 is a flowchart illustrating a method of dynamically configuring multiple screens according to an embodiment of the present invention.

12 is an exemplary diagram illustrating a software architecture for providing multiple screens in accordance with an embodiment of the present invention.

13 is an exemplary view illustrating a relationship between modules configuring an API layer according to an embodiment of the present invention.

FIG. 14 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG. 13.

15 is an exemplary view illustrating an operation of a search module according to an embodiment of the present invention.

16A through 16F are exemplary diagrams of code for screen searching according to an embodiment of the present invention.

FIG. 17 is a flowchart illustrating a process of exchanging a service represented on a logical screen by each module illustrated in FIG. 13.

<Explanation of symbols on main parts of the drawings>

910: broadcast signal receiving module

920a, 920b: storage media

930: external input module

940: Digital Signal Processing Module

950: user / application interface module

960: Search Module

970: motion module

980: display screen

990 external output module

The present invention relates to an apparatus for providing multiple screens and a method for dynamically configuring the multiple screens. More particularly, the present invention relates to a screen existing in a device for dynamically configuring a plurality of screens representing a plurality of services on a physical display screen. The present invention relates to a device for providing a multi-screen for retrieving the shape and the connection relationship of the two.

In a conventional broadcast receiver such as a digital TV or a digital set-top box, only one content is displayed on one physical display screen, or two main screens and a sub-screen are displayed on one physical display screen. It is common to show the screen at the same time.

In this case, even when the main screen and the sub-screen are simultaneously displayed, the two screens may be arranged only in a predetermined manner by the broadcast receiving apparatus. And only in the case of the content shown on the main screen, all elements constituting the content (video, audio, data, or a combination thereof) are played, and only some elements constituting the content are limitedly played through the sub-screen.

In addition to the broadcast services such as satellite broadcasting, terrestrial broadcasting, and cable broadcasting as a source for providing contents, there are a storage medium such as a DVD or an external device connected to an external input terminal, and the like. It is also fixed on a limited basis.

On the other hand, in an application program environment for an interactive TV such as a multimedia home platform (MHP), an advanced common application platform (ACAP), an open cable application platform (OCA), and the like, a screen that is generally output through a physical display screen Is assumed to be one.

For example, the application program environment for interactive TV employs a user interface (UI) structure according to the HAVi (Home Audio / Video Interoperability) standard. However, the HAVi UI standard does not limit the number of screens. However, in actual use, it is common to assume that there is only one screen output through the display screen.

In such an environment, a plurality of contents are displayed through a plurality of independent screens, and at the same time, decoding, digital signal processing, user interaction processing, and the like on the contents represented on each screen are performed dynamically, It is difficult to control life-cycle and resource usage on each screen.

Accordingly, there is a need for a method for configuring and providing various contents on a display screen in various ways.

An object of the present invention is to search for a form and a connection relationship of screens existing in a system in order to dynamically construct a plurality of screens representing a plurality of services on a physical display screen.

The objects of the present invention are not limited to the above-mentioned objects, and other objects which are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, an apparatus for providing a multi-screen according to an embodiment of the present invention is an operation module for generating at least one screen for representing a received service and a predetermined application included in the service of the screen It includes a search module for searching the screen to be executed.

An apparatus for providing multiple screens according to an embodiment of the present invention is an operation module for generating a logical screen for representing a received service and an output screen to which the logical screen is mapped, and for searching all the generated logical screens and output screens. It includes a search module.

An apparatus for providing multiple screens according to an embodiment of the present invention includes an operation module for generating a logical screen for representing a received service and an output screen to which the logical screen is mapped, and a search module for searching the logical screen and the output screen. It includes.

An apparatus for providing a multi-screen according to an embodiment of the present invention includes a broadcast signal receiving module for receiving a service, an operation module for generating a logic screen and an output screen to which the logic screen is mapped, and a screen representing the service. And a search module for searching whether the screen is the output screen.

According to an aspect of the present invention, there is provided a method of dynamically configuring a multi-screen, including generating at least one screen for representing a received service and searching for a screen on which a predetermined application included in the service is executed. Include.

According to an aspect of the present invention, there is provided a method of dynamically configuring a multi-screen, including generating a logical screen for representing a received service, generating an output screen to which the logical screen is mapped, and generating all the generated logical screens and outputs. Searching for the screen.

According to an aspect of the present invention, there is provided a method of dynamically configuring a multi-screen, including generating a logical screen for representing a received service, generating an output screen to which the logical screen is mapped, and generating the logical screen and the output screen. Searching.

According to an aspect of the present invention, there is provided a method of dynamically configuring a multi-screen, including receiving a service, generating a logical screen, generating an output screen to which the logical screen is mapped, and displaying a screen. Searching whether it is a logical screen or the output screen.

Specific details of other embodiments are included in the detailed description and the drawings.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims. Like reference numerals refer to like elements throughout.

Hereinafter, an exemplary embodiment of the present invention will be described with reference to a block diagram or a flowchart illustrating a method for dynamically configuring the multi-screen and a method for dynamically configuring the multi-screen according to embodiments of the present invention. At this point, it will be understood that each block of the flowchart illustrations and combinations of flowchart illustrations may be performed by computer program instructions. Since these computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, those instructions executed through the processor of the computer or other programmable data processing equipment may be described in flow chart block (s). It will create means to perform the functions. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in the flowchart block (s). Computer program instructions It is also possible to mount on a computer or other programmable data processing equipment, so that a series of operating steps are performed on the computer or other programmable data processing equipment to create a computer-implemented process to perform the computer or other programmable data processing equipment. It is also possible for the instructions to provide steps for performing the functions described in the flowchart block (s).

In addition, each block may represent a portion of a module, segment, or code that includes one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative implementations, the functions noted in the blocks may occur out of order. For example, the two blocks shown in succession may in fact be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the corresponding function.

On the other hand, to facilitate the description of the present invention to define the basic concepts related to the present invention.

'Service' is a multimedia content represented by a bundle, and a plurality of service components make up a service.

The 'service component' is a part constituting a service, and includes a video component, an audio component, a data component, and the like. At this time, the data component refers to an application existing in a service.

In addition, an application may be classified into an unbound application and a service bound application. Since the unbound application is not related to a specific channel, execution of the application is not affected by channel switching. Also, since they generally have a high priority, resources for execution are smoothly allocated. The monitor application is a special unbound application that can have the highest priority.

Service-bound applications, on the other hand, are related to transport streams and are generally given a lower priority than unbound applications. Service bound applications do not perform critical system functions and are more likely to give up resource allocation than unbound applications if contention for resources occurs. There are two types of service-bound applications that operate in conjunction with the current stream and non-interworking that operate independently of the stream being transmitted.

'Service context' includes various resource information, device information, and execution status information related to executing a service, and can control service execution. Represents an object.

'Display screen (physical display device)' refers to the physical device (device) in which the contents of the service is actually expressed, the external output port (output port) in which the contents of the service are output, or the storage device in which the service is stored. .

An 'display screen' is a screen that is actually output on a display screen, in which any service is set directly on the output screen and represented through the display screen, or at least one logical screen mapped to a certain area of the output screen is displayed. It is output through the screen.

The 'logical screen' is a space in which an arbitrary service is represented and exists virtually only in memory before being mapped to an output screen and is not represented on an actual display screen.

In addition, the logic screen and the output screen can consist of a combination of background still images, video rasters, and graphic rasters, where the graphic raster is text. ), Lines, colors and images may be synthesized or video frames may be provided in a mixture.

The 'main service' refers to a service selected by the user as a main service through a menu or a remote control displayed on the display screen or by an application through the API, and refers to a screen on which the main service is represented. It is called.

'PiP Screen (Picture-in-Picture screen)' is a screen occupying some area in another screen as shown in Figs. 1A to 1D, and in Figs. A screen which is simultaneously shown in an area which does not overlap with another screen as shown, and also shown in any position and area within the display screen as shown in FIGS. 1G and 1H, or It can be understood as a concept including a screen that is displayed in superimposition with another screen.

2 is an exemplary view showing a relationship between a logic screen and an output screen according to an embodiment of the present invention.

Referring to FIG. 2, a service may be represented through logic screens 210, 212, and 214, which are then mapped and represented by output mappings 220, 222, and 224 by a predetermined mapping block 230. Can be.

In this case, the output screen referred to as 220 is represented by mapping logic screens referred to as 210 and 212, and the output screen referred to as 222 is represented as mapped logical logic screens referred to as 212 and 214, and referred to as 224. The output screen is mapped with the logical screens referred to as 210, 212 and 214.

As such, at least one logical screen on which the service is represented may be mapped to any area of the output screen by the mapping block 230.

On the other hand, the mapping block 230 may be understood as a collection of various information for mapping the logical screen and the output screen. Examples of such information may include coordinate information of an area where the logical screen is mapped to the output screen, identification information for distinguishing the logical screen from the output screen, information about the order in which the plurality of logical screens are displayed on the output screen, and the like. .

The mapping block 230 may change the size of the logical screen and allocate the same to a predetermined area of the output screen. That is, the mapping block 230 may perform a scaling function and a position allocation function for the logical screen, and FIGS. 3A to 3E illustrate the configuration of a screen including such a mapping block, that is, a mapper. have.

Referring to FIG. 3A, a main screen composed of a combination of a background still image (B), a video raster (V), and a graphic raster (G) is defined by a mapper. It is mapped to the entirety of the output screen while maintaining the size. PiP screens with only video components are mapped to a given area of the output screen as their size is reduced by a mapper. At this point, the mapped PiP screen is placed on the main screen, which is determined by the Z value. Z denotes a z-order value, and the z-order will be described later. In addition, an overlay screen can be composited with the output screen, which is the outermost special screen that can be used, for example, when it is necessary to provide a caption. The PiP screen may have only video components as in FIG. 3A, but as shown in FIG. 3B, a background still image (B), a video raster (V) and a graphic raster are shown. It may consist of a combination of (G).

Referring to FIG. 3C, a main screen made up of a combination of background still image (B), video raster (V) and graphic raster (G) is mapped by the mapper to the entirety of the output screen while maintaining its size. The two PiP screens # 1 and # 2 having only the video component are each mapped by a mapper to a certain area of the output screen as their size is reduced. At this time, the mapped PiP screens are placed on the main screen, and the Z value can remain the same. In addition, an overlay screen can be combined with the output screen. The screen configuration may include a plurality of PiP screens having only video components as in FIG. 3C, but as shown in FIG. 3D in a combination of background still image (B), video raster (V) and graphic raster (G). It may also consist of a plurality of PiP screens.

In FIG. 3E, a POP screen is illustrated. If the conventional PiP screen is a screen displayed inside the main screen, the POP screen may be understood as a screen displayed outside the main screen. Referring to FIG. 3E, a plurality of POP screens # 1 and # 2 having a combination of a background still image (B), a video raster (V), and a graphic raster (G) are each sized by a mapper. It gets smaller and maps to a certain area of the output screen. At this time, the Z values of the mapped POP screens # 1 and # 2 may be kept the same. In addition, an overlay screen may be represented by being synthesized with the output screen.

In addition, the mapping block 230 may be implemented as an interface, a function, or the like, which is written and executed in various computer program languages. The above information may be used as a parameter to create or change a relationship between the logical screen and the output screen. .

In addition, the mapping block 230 may be implemented in hardware to perform a mapping function between the logical screen and the output screen.

In the output screen, services provided from various sources may be represented and output through a display screen, which is illustrated in FIG. 4.

Generally, as a source for providing a service, there is a source for providing a broadcast service such as terrestrial broadcasting 320 or cable broadcasting 330, and a service stored in a predetermined storage medium such as a personal video recorder (PVR) 340. There is also a source available. In addition, although not shown in FIG. 4, a source for providing a service through a wired or wireless network may also be included.

At this time, the broadcast receiving device 310 receives a service from these sources, and generates a logical screen representing each service.

Then, according to a preset method, a method set by a user or an application, any service is directly set on the output screen and represented through the display screen 350 or at least one logical screen mapped to a predetermined area of the output screen. It is output through the display screen 350. In FIG. 4, the services provided by the terrestrial broadcast 320, the cable broadcast 330, and the PVR 340 are represented through the display screen 350.

In FIG. 4, as an example of a source for providing a service, a terrestrial broadcast 320, a cable broadcast 330, and a personal video recorder (PVR) 340 are illustrated, but a source for providing a service is not limited thereto. If the multimedia content is represented as a bundle can be included in the source in the present invention.

Meanwhile, the services of the present invention include an abstract service and a non-abstract service, which are illustrated in FIGS. 5A and 5B, respectively.

An abstract service is an independent service for a broadcast channel, not a service delivered in real time from a broadcast signal. Among the service components, an abstract service includes a data component, that is, an application only, without a video component or an audio component. It may correspond to. For example, services that consist of unbound applications in the Open Cable Application Platform (OCAP) specification fall into this category.

A non-abstract service can be understood as a service other than an abstract service.

In the present invention, independence may be provided for each of the abstract service and the non-abstract service. For example, an abstract service may be set on an output screen directly without going through a logical screen, and a non-abstract service may be represented on a logical screen and mapped to an output screen on which an abstract service is set. The output screen can then be output via the display screen, whereby the abstract and non-abstract services can be represented independently on one output screen. In addition, both abstract and non-abstract services may be mapped to separate logical screens, and then each logical screen may be mapped to one output screen. In other words, the abstract service and the non-abstract service may be represented on the output screen as independent forms.

Meanwhile, in the present invention, the logical screen and the output screen may be defined as separate objects, but the screen may function as the logical screen or the output screen according to the attribute information of one object called the screen. have.

That is, it is possible to know whether the screen is a logical screen or an output screen through type information among attribute information about the screen object.

As attribute information of the screen object, there are attribute information such as 'Type', 'z-order', 'Display_Area', 'Visibility', 'Associated_Display_Screen', 'Associated_Service_Contexts', and 'OutputPort'.

6 shows the attribute information of the screen object and the type of interface for processing the attribute information.

'Type' attribute 510 is attribute information indicating whether the screen is a logical screen or an output screen.

The 'z-order' attribute 520 is for determining the order on the z-axis when the logical screens are represented on the output screen, and FIG. 7 illustrates how the logical screen appears according to the z-order attribute on the output screen. Doing.

In FIG. 7, the first logical screen 620 and the second logical screen 630 are mapped to a certain area on the output screen 610. At this time, the first logical screen 620 is represented on the output screen, and the second logical screen 630 is represented above it. That is, it is expressed in the order of the output screen 610, the first logical screen 620 and the second logical screen 630 in the z-axis direction, in this case the z-order attribute value of the first logical screen 620 With this 1, the z-order attribute value of the second logical screen 620 can be set to 2. At this time, the z-order attribute value can be in any number or character form as long as it indicates the order in which the logical screen is expressed on the z axis of the output screen.

The 'Display_Area' property 530 indicates information about an area of an output screen to be output by mapping a logical screen to an output screen, which is illustrated in FIGS. 8A and 8B.

FIG. 8A illustrates that the logic screen 710 is mapped to the entire area of the output screen 720 and is output. FIG. 8B illustrates that the logic screen 730 is mapped and output to a partial area of the output screen 740. have.

In this case, the information representing the 'Display_Area' attribute 530 may be two-dimensional coordinate information on the output screen, or may be expressed as a specific position on the output screen and an offset value from the specific position.

The 'Visibility' attribute 540 is an attribute that determines whether or not the logical screen is to be shown on the output screen. By changing this attribute value, the logical screen can be made visible or disappeared on the physical display screen.

The 'Associated_Display_Screen' property 550 indicates identification information of output screens associated with the logical screen. Logical screens that are not connected to an output screen are not shown on the display screen or sent to other external outputs.

The 'Associated_Service_Contexts' attribute 560 represents information about service contexts associated with the logical screen or output screen itself, with the service set in the service context being represented on the logical screen or output screen.

The 'OutputPort' attribute 570 indicates information about an object on which an output screen is output, and may include a display screen, a wired / wireless communication medium, and various storage media as an object on which the output screen is output.

Meanwhile, interfaces for acquiring or changing the value of the attribute information shown in FIG. 6 may be provided, as shown in FIG. 6, setting a value of the attribute information or connecting a logical screen to an output screen. 'Set' interface to add the value of the property information or 'add' interface to connect the logical screen with the service, 'get' interface to get the value of the property information, '' to delete the value of the property information remove 'interface. Such an interface may be understood as a process, a function, a procedure, a method, or the like that performs each function.

For example, the 'getDisplayScreen (void)' method functions to return an output screen associated with the current screen. For example, if the current screen is a logical screen, the associated output screen is returned. If the current screen is an output screen, reference information about the current screen is returned. If the current screen is a logical screen but no associated output screen exists. Returns null.

As another example, the 'public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException' method provides the ability to associate the current logical screen with a given area of the associated output screen. The instance provided as a parameter is a 'HScreenRectangle' class type of the 'org.havi.ui' package and has two-dimensional location information. As an exception for the 'setDisplayArea (HScreenRectangle rect)' method, an 'SecurityException' exception and an 'IllegalStateException' exception may be performed. An 'IllegalStateException' exception may be performed if the current screen is not a logical screen, or if the area of the output screen associated with the current logical screen cannot be changed due to the nature of the hardware or software platform.

As another example, the 'getDisplayArea (void)' method returns information about the current screen area in the form of the 'HScreenRectangle' class. If the current screen is an output screen, 'HScreenRectangle' information having the same value as 'HScreenRectangle (0,0,1,1)' is returned. If the current screen is a logical screen, the associated output screen is returned. Information about the area occupied by the logical screen is returned. If the current screen is a logical screen but there is no associated output screen, then a NULL value is returned.

Each interface name mentioned above is merely a name for indicating each function, and should not be limited to the name but should be understood as the function.

9 is an exemplary diagram illustrating a process in which two services are respectively set in two logical screens and mapped and output in one output screen.

Referring to FIG. 9, the first service is a service in which all three service components of video / audio / data exist, and the second service is an example in which only a video component and an audio component exist. Of course, the present invention does not place any restrictions on the service component, and FIG. 9 shows one possible example.

As shown in FIG. 9, the first service and the second service are displayed on the display screen in a similar manner to the conventional method, but according to the present invention, a plurality of services may be applied to the display screen through mapping without limitation. Can be expressed independently in various positions.

10 is a block diagram showing the configuration of an apparatus for providing multiple screens according to an embodiment of the present invention.

Referring to FIG. 10, the multi-screen providing apparatus 900 according to the present invention includes a digital signal processing module 940, an operation module 970, a user / application interface module 950, and a search module 960.

In this case, a source for providing a service may include a broadcast signal receiving module 910, a storage medium 920a, or an external input module 930, and a display screen 980 as a medium for outputting a service. May include a storage medium 920b or an external output module 990.

In this case, the term 'module' used in the present embodiment refers to software or a hardware component such as an FPGA or an ASIC, and a module plays a role. However, modules are not meant to be limited to software or hardware. The module may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a module may include components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, subroutines. , Segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules. In addition, the components and modules may be implemented to play one or more CPUs in a device or secure multimedia card.

The digital signal processing module 940 includes various configuration information constituting a service such as multimedia content from the broadcast signal receiving module 910, the storage medium 920a, or the external input module 930, for example, video information and audio information. Or data information or the like.

In this case, the broadcast signal receiving module 910 is a module for receiving and transmitting satellite, terrestrial or cable broadcast signals, and the storage medium 920a represents a device in which video information, audio information, or data information, etc., which constitute a service are stored. The external input module 930 may be understood as a module that receives and transmits video information, audio information, or data information constituting a service from another networked device such as a network interface module.

The digital signal processing module 940 restores a service by using the received service components, and may restore a plurality of services. At this time, the restored service includes an abstract service or a non-abstract service.

In addition, the term 'plural services' may mean, for example, two or more services delivered from the broadcast signal receiving module 910, and may be delivered from each of the broadcast signal receiving module 910 and the storage medium 920a. It may mean two or more services.

The service restored by the digital signal processing module 940 may be restored according to the selection of a user or an application through the user / application interface module 950. At this time, the user or the application may select which service to connect to which screen.

The operation module 970 represents the service restored by the digital signal processing module 940 on the logical screen, and then maps the logical screen to the output screen or directly expresses the service on the output screen. To this end, the operation module 970 may include a service processing module 972 and an output module 974.

The service processing module 972 generates a logical screen and an output screen for representing the service restored by the digital signal processing module 940.

The output module 974 maps and outputs the logical screens generated by the service processing module 972 to a predetermined area on the output screen. At this point, the mapping onto the output screen may already be set or may be set by the user or application via the user / application interface module 950.

In addition, the service processing module 972 may generate multiple output screens, in which case only output screens selected through the user / application interface module 950 may be provided through the output module 974.

In addition, the service restored by the digital signal processing module 940 may be directly connected to the output screen and output by the output module 974 instead of being connected to the logical screen in the service processing module 972.

The output screen by the output module 974 may be output through the physical display screen 980 or may be stored in the storage medium 920b. The storage medium 920b may be read by a computer and includes a floppy disk, a hard disk, a CD-ROM, a DVD, a DVD-ROM, a BD (Blu-ray Disc), and a semiconductor memory.

Also, it may be delivered to another device connected through a network through the external output module 990.

For this purpose, the output module 974 may comprise a number of output ports on which an output screen is provided, in which case the output port designated via the default output port or user / application interface module 950 already set. Through the output screen can be provided.

The search module 960 searches for the form and connection of screens present in the system. Such a search may be classified into four types. The search module 960 may search for a screen on which an application included in a received service is executed from among at least one or more screens (hereinafter, referred to as a first search). You can search all logical screens and output screens created in (hereinafter referred to as a second search), and you can search logical screens for representing received services and output screens to which the logical screens are mapped (hereinafter, It is possible to search whether the screen representing the received service is a logical screen or an output screen (hereinafter referred to as a fourth search).

Here, the screen searched through the first to fourth search processes may be a logical screen or an output screen.

In performing the first search, the search module 960 may search a setting form of a screen on which an application is executed, wherein the setting form is a single screen form or a single screen in which the screen on which the application is executed corresponds to an output screen. A nested screen form that coexists with the at least one nested screen, a screen on which the application is executed corresponds to a logical screen mapped to the entire area of the output screen, and at least one non-overlapping logical screen mapped to the output screen, Combination of PiP screen types that do not correspond to nested screens, nested PiP screen types where the PiP screens coexist with at least one or more nested screens, and at least two non-overlapping logic screens where the screen on which the application is run is mapped to the entire area of the output screen. Corresponding to, not corresponding to overlapping screen At least one of a non-PoP screen form, a superimposed PoP screen in which the PoP screen coexists with at least one or more overlapping screens, and a general form not belonging to any of the above forms.

In performing the second search, the search module 960 may perform the search only for the logical screen and the output screen only when the permission is granted by referring to the permission range of the application. Here, the permission range of the application is granted by the service provider, and the search module 960 may search only some screens included in the permission range of the application among the screens generated by the operation module 970. On the other hand, the search module 960 may search all logical screens and output screens if no privilege range is granted from the service provider.

In performing the fourth search, the search module 960, if the screen on which the application is executed is a logical screen (hereinafter referred to as an execution logic screen), displays the position, size, and size of the execution logic screen on the output screen. You can search for overlapping relationships between existing logic screens and execution logic screens. Here, the position of the execution logic screen includes not only the plane coordinates on the output screen but also the z-order, which is the order on the z-axis.

In addition, in performing the fourth search, the search module 960 may search the service context of the searched screen.

Meanwhile, the search module 960 performs a search by a control command input from a user or a control command of an application provided from a service provider. The search by the control command of the application means that the search module 960 performs the search according to the control command of the currently transmitted application or the previously stored application.

The user or application may select or restore a desired service through the user / application interface module 950. In addition, a user or an application may select any output screen from among a plurality of output screens through the user / application interface module 950. In order to perform such a task, the user / application interface module 950 may use a search module 960. Can use the search results.

Since each module illustrated in FIG. 10 is shown separately according to each function, the modules may be combined with other modules in an actual implementation.

11 is a flowchart illustrating a method of dynamically configuring multiple screens according to an embodiment of the present invention.

In general, video information, audio information, data information, etc. constituting multimedia content are delivered according to a predetermined format such as, for example, an MPEG stream. Therefore, the device executing the service such as the multimedia content receives the above information and restores the corresponding service (S1010). At this time, the service to be restored may be selected or preset by the user or the application. The user can select which service to connect to which screen by using a menu or remote control displayed on the display screen or by using an API.

On the other hand, the data information includes application information about an application existing in the service, and the application information includes signal information indicating whether the application can be executed on the PiP screen. Examples of the application information include an application information table (AIT) according to the MHP standard and an eXtended Application Information Table (XAIT) according to the OCAP standard, and the signal information may be added to the application information.

Then, the restored service is set to be represented on the logical screen according to the present invention (S1020), and after mapping the logical screen to the output screen according to the present invention (S1030), the display screen 980, the storage medium ( 920b) or the output screen is provided through a network (S1040).

In this way, after the logical screen and the output screen are generated, the search module 960 performs a search for the generated screen (S1050). The search performed by the search module 960 includes the first to fourth searches described above, which may be performed according to a control command of a user or an application input through the user / application interface module 950. Detailed description of the search has been described above with reference to FIG. 10 and will be omitted.

Meanwhile, although the restored service is represented as being provided through the output screen through the logical screen in FIG. 11, the restored service may be provided through the output screen directly without passing through the logical screen.

In addition, when the user selects a PiP service, the PiP service may be represented in two modes. In the first mode, a separate logical screen, for example, a PiP screen for the PiP service, is not generated, and the video of the PiP service selected in the main screen is displayed. Only components are represented, and in the second mode, a separate logical screen for the PiP service is created to represent the selected PiP service within the generated PiP screen.

In FIG. 11, a process of mapping one service to an output screen is described for convenience of description. However, the screen property information may be used to display a plurality of services through a plurality of logical screens or directly in an arbitrary area within one output screen. Can be mapped to

Therefore, when the output screen is provided through the display screen, the user or the application can execute a plurality of services.

12 is an exemplary diagram illustrating a software architecture for providing multiple screens in accordance with an embodiment of the present invention.

Referring to FIG. 12, the software architecture 1100 according to the present invention may include a device driver layer 1110, an application program interface layer 1120, and an application layer 1130. Include.

The device driver layer 1110 receives and decodes service components constituting a service from various sources that provide multimedia content. In this case, examples of the service component include video information, audio information or data information.

The API layer 1120 creates a logical screen and an output screen and performs mapping between services, logical screens, and output screens.

The application layer 1130 may provide a user interface that allows a user to dynamically configure a logical screen on which a service is expressed, or transmit a user's command to the API layer 1120 to perform an operation according to the command. have.

In order to perform such a task, the application layer 1130 may perform a task through an application currently transmitted or a previously stored application, and a task such as screen search may also be performed through the application layer 1130.

Meanwhile, the user may cause the device driver layer 1110 to output the output screen through the physical display screen or store the output screen through the application layer 1130 in the storage medium 920b. In addition, the device driver layer 1110 may transmit the output screen to another device through a network.

To this end, the device driver layer 1110 may include a plurality of output ports providing the output screen, but a plurality of output ports may be present in the API layer 1120.

Meanwhile, in order to dynamically configure a plurality of logical screens on an output screen, the API layer 1120 may include a plurality of software modules, wherein the 'MultiScreenManager' module, 'MultiScreenContext' module, 'MultiScreenContextListener' module, and ' MultiScreenContextEvent 'module is described as an example, and the relationship between these modules is shown in FIG.

The 'MultiScreenManager' module 1210 manages the 'MultiScreenContext' module, finds a desired screen, informs device sharing information between the screens, or plays a role in registering or unregistering the 'MultiScreenContextListener' module 1250.

The 'MultiScreenContext' module 1230 is an interface object for the screen object in association with the screen object 1220. The screen type of the screen object may be determined as a logical screen and an output screen according to the interface operation of the 'MultiScreenContext' module 1230. And various attribute information shown in FIG. 6 may be set. The aforementioned 'set', 'add', 'get', and 'remove' interfaces may be provided by the 'MultiScreenContext' module 1230.

The 'MultiScreenContextEvent' module 1240 is an event class for notifying when property information of the screen object 1220 is changed by the 'MultiScreenContext' interface object 1230, and the 'MultiScreenContextListener' module 1250 A listener interface object that can be implemented in a predetermined application class that wants to receive an event by the 'MultiScreenContextEvent' module 1240.

Meanwhile, the application 1260 is a module operating in the application layer 1130 and allows a user to select a desired service and freely arrange a plurality of logical screens according to a desired form on an output screen.

Thus, if application 1260 communicates commands to MultiScreenManager module 1210 regarding the user's dynamic placement and management of a logical screen, MultiScreenManager module 1210 corresponds to the commands via MultiScreenContext module 1230. Perform the action.

Meanwhile, the MultiScreenContext module 1230 may manage attribute information of the screen object 1220 illustrated in FIG. 6 in association with the screen object 1220 and may include various functions or methods for such management. .

Meanwhile, although not shown, the MultiScreenManager module 1210 may operate to receive service components provided from various sources from the device driver layer 1110 so that they can be displayed on a logical screen or an output screen. Of course, this function may be performed through a separate module (not shown).

In addition, the application may perform a screen search operation by using the search module 960, which will be described later with reference to FIG. 15.

FIG. 14 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG. 13.

First, the MultiScreenManager module 1210 generates one output screen and as many logical screens as the number of services to be executed (S1310).

Then, the MultiScreenManager module 1210 connects each logical screen with a service received from the device driver layer 1110 (S1320). At this time, for each logical screen, the 'addServiceContext' method of the logical screen object may be called using the service context object for the service to be connected as a parameter. Here, the 'addServiceContext' method may be understood as a method that performs a function of connecting a logical screen and a service, and may be provided by the MultiScreenContext module 1230.

When the logical screen and the service are connected, the MultiScreenManager module 1210 connects each logical screen with the output screen (S1330). At this time, for each logical screen, the 'setDisplayScreen' method of the logical screen object may be called using the output screen object to be connected as a parameter. Herein, the 'setDisplayScreen' method may be understood as a method that performs a function of connecting a logical screen and an output screen, and may be provided by the MultiScreenContext module 1230.

For example, the 'setDisplayScreen' method can be expressed in the form of 'public void setDisplayScreen (HScreen screen) throws SecurityException, IllegalStateException', which maps the 'HScreen' instance provided as a parameter to the current logical screen. To provide. In this case, the 'HScreen' instance is preferably an output screen.

The parameter of the 'setDisplayScreen (HScreen screen)' method may include 'NULL'. In this case, when the 'setDisplayScreen (HScreen screen)' method is executed without exception handling, the current logical screen is no longer present. It is not associated with an output screen.

As an exception for the 'setDisplayScreen (HScreen screen)' method, an 'SecurityException' exception and an 'IllegalStateException' exception may be performed.

An 'IllegalStateException' exception is that the current screen is not a logical screen, or due to the nature of the hardware or software platform, an output screen that is provided as a parameter is associated with a particular logical screen to associate the current logical screen with an output screen corresponding to that parameter. It can be done if it can't.

When a service and a logical screen, and a plurality of logical screens and one output screen are connected, an area of an output screen on which each logical screen is to be represented is set (S1340). At this time, for each logical screen, a method provided by the MultiScreenContext module 1230 may be called to set an area to be displayed on the output screen.

15 is a diagram illustrating an operation of the search module 960 according to an embodiment of the present invention, in which the search module 960 performs the above-described first to fourth searches 1510, 1520, 1530, and 1540. Can be.

In order to perform the first search 1510, the search module 960 may call a 'getScreenConfiguration' method. Here, the 'getScreenConfiguration' method is a method that returns an instance of the configuration type of the currently activated screen, which may be provided by the MultiScreenConfiguration class.

For example, the 'getScreenConfiguration' method can be expressed in the form of 'public MultiScreenConfiguration getScreenConfiguration () throws java.lang.SecurityException', which returns a MultiScreenConfiguration that is an instance of the configuration type of the currently active screen.

In addition, when a call to the 'getScreenConfiguration' method is not allowed, an 'SecurityException' exception may be executed.

In addition, the search module 960 may call a 'getScreenConfigurationType' method to check a specific configuration form of the screen. Here, the 'getScreenConfigurationType' method is a method for returning the setting type of the currently activated screen and may be provided by the MultiScreenConfiguration interface.

For example, the 'getScreenConfigurationType' method

'int getScreenConfigurationType ()

{return SCREEN_CONFIGURATION_NON_PIP,

SCREEN_CONFIGURATION_NON_PIP_WITH_OVERLAY,

SCREEN_CONFIGURATION_PIP,

SCREEN_CONFIGURATION_PIP_WITH_OVERLAY,

SCREEN_CONFIGURATION_POP,

SCREEN_CONFIGURATION_POP_WITH_OVERLAY,

SCREEN_CONFIGURATION_GENERAL} '. This method returns the configuration type of the currently active screen as its data type, integer. Here, the setting forms listed above correspond to the above-described single screen form, superimposed screen form, PiP screen form, superimposed PiP screen form, PoP screen form, superimposed PoP screen form and general form, respectively.

FIG. 16A illustrates an example of a code for searching for a setting form of a screen, and is a code for searching whether a setting form of a currently activated screen is PiP or PoP. That is, the search module 960 regards the case where the setting form is SCREEN_CONFIGURATION_PIP, the SCREEN_CONFIGURATION_PIP_WITH_OVERLAY is PiP, the case where the setting form is SCREEN_CONFIGURATION_POP, and the case where the setting form is SCREEN_CONFIGURATION_POP_WITH_OVERLAY is PoP, and all the other cases of PoP are It is not considered to be.

In order to perform the second search 1520, the search module 960 may call a 'getScreens' method. Here, the 'getScreens' method returns a set of all screens created on the device, and its data type is the 'HScreen' class type of the 'org.havi.ui' package. In other words, the 'getScreens' method returns a set of all 'HScreen' instances created on the device.

FIG. 16B is an exemplary diagram of a code for searching for all instances of screens generated in a device, and is a code for searching for a setting type of a screen using the found instance. That is, 'screens', which is an instance of the accessible screen returned through the 'getScreens' method, is extracted, and the setting type of each screen is sequentially retrieved.

In order to perform the third search 1530, the search module 960 may call an 'org.havi.ui.HScreen.getDefaultHScreen' method. Here, the 'getDefaultHScreen' method is for retrieving a single screen. If you define the default screen of the application as the screen to which the application belongs, the application can find out the screen to which it belongs using the 'getDefaultHScreen' API.

Meanwhile, in order to retrieve an output screen mapped with the logical screen, the search module 960 may call a 'getDisplayScreen' method. Here, the 'getDisplayScreen' method is a method for returning an output screen connected to a logical screen. The data type is 'HScreen' class type and may be provided by the 'MultiScreenContext' interface.

The 'getDisplayScreen' method returns a reference address for the type of the called 'HScreen' if it is an output screen, and a reference address for the output screen if the type of the called 'HScreen' is a logical screen and is associated with the output screen. Returns. On the other hand, the 'getDisplayScreen' method returns NULL if the type of the called 'HScreen' is a logical screen and the logical screen is not connected to the output screen.

FIG. 16C illustrates an example of code for searching for a screen to which an application belongs, and is a code for searching for an output screen after determining whether a screen to which the application belongs is a logical screen or an output screen.

In other words, the 'getDefaultHScreen' method is used to extract the default screen 'screen', which is applied to the 'getScreenType' method to determine whether the screen is a logical screen or an output screen, and accordingly the 'getDisplayScreen' method is an output screen. Will return

In order to perform the fourth search 1540, the search module 960 may call a 'getScreenType' method, a 'getDisplayArea' method, a 'getZOrder' method, and a 'getServiceContexts' method. Here, the 'getScreenType' method is for searching whether the screen is a logical screen or an output screen. The data type is an integer and returns 'SCREEN_TYPE_DISPLAY' or 'SCREEN_TYPE_LOGICAL'.

'SCREEN_TYPE_DISPLAY' is a value representing the output screen. When 'HScreen' is connected to 'VideoOutputPort' and mapped to the video raster generated from 'VideoOutputPort', the type of 'HScreen' becomes 'SCREEN_TYPE_DISPLAY'. HScreen 'is called output' HScreen '.

On the other hand, 'SCREEN_TYPE_LOGICAL' is a value representing a logical screen, and when 'HScreen' is not connected to 'VideoOutputPort' and is mapped to a sub-region of a video raster generated from 'VideoOutputPort', The type becomes 'SCREEN_TYPE_LOGICAL', where 'HScreen' is called logical 'HScreen'.

Logical 'HScreen' may be connected to output 'HScreen', and if logical 'HScreen' is not connected to output 'HScreen', a visible and audible service will be connected to 'HScreen'. It may not be created by 'ServiceContext'.

FIG. 16D illustrates an example of code for searching for a form of a screen to which an application belongs, and is a code for searching whether a corresponding screen is a logical screen or an output screen using a 'getScreenType' method.

The 'getDisplayArea' and 'getZOrder' methods can be called to retrieve the coordinates and z-order of the application located on the output screen.

The getDisplayArea method returns the coordinates of the logical screen mapped to the output screen, whose data type is of the 'org.havi.ui.HScreenRectangle' class type. The 'getDisplayArea' method returns an extent of 'HScreen'. If the type of 'HScreen' is 'SCREEN_TYPE_DISPLAY', it returns 'HScreenRectangle (0, 0, 1, 1)'. If the type is 'SCREEN_TYPE_LOGICAL' and 'HScreen' is connected to the output 'HScreen', the area allocated to the logical 'HScreen' is returned. Also, if the type of 'HScreen' is 'SCREEN_TYPE_LOGICAL' and 'HScreen' is not connected to the output 'HScreen', the 'getDisplayArea' method returns NULL.

FIG. 16E illustrates an example of code for retrieving a position and size on an output screen of a logical screen to which an application belongs, and is a code for retrieving the position and size of a corresponding screen using a 'getDisplayArea' method.

The getZOrder method returns the z-order of the logical screen mapped to the output screen, whose data type is integer. The 'getZOrder' method returns a z-order of 0 if the 'HScreen' is the output 'HScreen', and a z-order with 1 or more if the 'HScreen' is the logical 'HScreen'.

The 'getServiceContexts' method can be called to retrieve the service contexts associated with the screen.

The 'getServiceContexts' method returns a set of service contexts associated with 'HScreen'. The data type is of the 'javax.tv.service.selection.ServiceContext' class type.

FIG. 16F illustrates an example of code for retrieving a service context of a screen to which an application belongs, and is a code for retrieving service contexts of a corresponding screen by using a 'getServiceContexts' method.

FIG. 17 is a flowchart illustrating a process of exchanging a service represented on a logical screen by each module illustrated in FIG. 13.

First, the MultiScreenManager module 1210 suspends services existing in two logical screens whose services are to be exchanged with each other (S1410).

Then, the information of the service connected to the two logical screens is exchanged (S1420). At this time, the service context set in the logical screen can be exchanged by calling the 'removeServiceContext' method and the 'addServiceContext' method for each of the two logical screen objects. Here, the 'removeServiceContext' method may be understood as a method for removing a service context connected to a logical screen, and the 'addServiceContext' method is used as a method for adding a new service context to a logical screen. The 'removeServiceContext' method and the 'addServiceContext' method may be provided by the MultiScreenContext module 1230. That is, in the present invention, not only the effect of exchanging the main and sub screens of the conventional main screen by exchanging information on the service connected to the logical screen, but also three or more services are demonstrated on the display screen 980, for example. It is possible to exchange services between a number of logical screens.

When the information of the services connected to the two logical screens is exchanged, an event indicating that the connection between the service and the logical screen is changed is generated (S1430), and then the 'MultiScreenContextEvent' module 1240 sends the generated event to the 'MultiScreenContextListener' module 1250. ), And execution of the service newly connected to the two logical screens is resumed (S1440).

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

According to the apparatus for providing a multi-screen of the present invention and the dynamic configuration method of the multi-screen as described above, a plurality of screens for providing a plurality of contents on a physical display screen by searching for the form and connection relationship of the screens present in the system Has the advantage of allowing the user or application to easily and dynamically configure.

Claims (51)

delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete An apparatus for receiving at least one of a video service, an audio service, and a data service, and providing a screen displaying the received service. A module configured to set screen property information of the screen including association information between the screen and the service and the screen setting type information; A module for managing a setting operation of the screen attribute information such that the received service is represented on the screen; And And a module for identifying a screen accessible by an application among the screens. The method of claim 36, And the application is an application included in the data service. The method of claim 36, wherein the screen identification module, And identifying a screen accessible by the application based on service context information associated with the screen among screen property information of the screen. The method of claim 36, The screen property information may further include at least one of display mode information of the screen and association information between the screen and an output port. delete delete The method of claim 36, The screen providing apparatus, characterized in that at least one screen. The method of claim 36, The screen comprises at least one of a logic screen and an output screen, And the output screen is a screen output to an output port, and the logical screen is a screen to which the service is associated. A method of receiving a video service, an audio service, a data service and receiving at least one service, and configuring a screen displaying the received service. Setting screen property information of the screen including the correlation between the screen and the service and the screen setting type information; Managing a setting operation of the screen attribute information such that the received service is represented on the screen; And Identifying a screen accessible by an application among the screens. The method of claim 44, And the application is an application included in the data service. 45. The method of claim 44, wherein checking the screen And identifying a screen accessible by the application based on service context information associated with the screen among screen property information of the screen. The method of claim 44, The screen property information may further include at least one of display method information of the screen and association information between the screen and an output port. delete delete The method of claim 44, And at least one of said screens. The method of claim 44, The screen comprises at least one of a logic screen and an output screen, The output screen is a screen output to an output port, and the logical screen is a screen to which the service is associated.

Images