KR20070017010A - Apparatus and method for multiple screen - Google Patents

Abstract

The present invention relates to an apparatus and a method for providing a multi-screen, and the apparatus for providing a multi-screen according to an embodiment of the present invention provides a user / application interface module that receives a mode related to a PiP service operation and when the input mode is a first mode. A video component of the service is represented in the main screen and an output module in which the background video or video component of the service is represented in the PiP screen when the input mode is the second mode.

Multiple Screen, Logic Screen, Output Screen, Service, OCAP

Description

Apparatus and method for multiple screen providing device and method

1 is an exemplary view showing a form in which a PiP screen is disposed according to an embodiment of the present invention.

2 is an exemplary view showing a relationship between a logic screen and an output screen according to an embodiment of the present invention.

3A to 3E are diagrams illustrating the configuration of a screen including a mapper according to an embodiment of the present invention.

4 is an exemplary diagram illustrating an example of a source for providing a service according to an embodiment of the present invention.

5A and 5B are exemplary diagrams illustrating examples of abstract services and non-abstract services according to an embodiment of the present invention.

6 is an exemplary diagram illustrating attribute information and interface types in a logical screen and an output screen.

7 is an exemplary diagram illustrating a 'z-order' attribute of a logical screen.

8A and 8B are exemplary diagrams illustrating a 'Display_Area' property of a logical screen.

9 is an exemplary diagram illustrating a process in which two services are mapped and output on one output screen.

10 is a block diagram showing the configuration of a multi-screen providing apparatus according to an embodiment of the present invention.

11 is a flowchart illustrating a method of providing a service through multiple screens dynamically configured according to an embodiment of the present invention.

12A and 12B illustrate a PiP service providing mode according to an embodiment of the present invention.

13 is an exemplary diagram illustrating a software architecture for providing multiple screens in accordance with an embodiment of the present invention.

14 is an exemplary diagram illustrating a relationship between modules configuring an API layer according to an embodiment of the present invention.

FIG. 15 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG. 14.

<Description of Main Parts of Drawings>

900: multi-screen providing device

910: broadcast signal receiving module

920 storage medium

930: external input module

940: digital signal processing module

950: service processing module

960: output module

965: user / application interface module

970: display screen

980 storage medium

990: external output module

The present invention relates to providing multiple screens, and more particularly, to an apparatus and method for providing a plurality of services through a plurality of screens dynamically configured in a physical display screen.

In a conventional broadcast receiver such as a digital TV or a digital set-top box, only one content is displayed on one physical display screen, or two main screens and a sub-screen are displayed on one physical display screen. It is common to show the screen at the same time.

In this case, even when the main screen and the sub-screen are simultaneously displayed, the two screens may be arranged only in a predetermined manner by the broadcast receiving apparatus. And only in the case of the content shown on the main screen, all elements constituting the content (video, audio, data, or a combination thereof) are played, and only some elements constituting the content are limitedly played through the sub-screen.

In addition to the broadcast services such as satellite broadcasting, terrestrial broadcasting, and cable broadcasting as a source for providing contents, there are a storage medium such as a DVD or an external device connected to an external input terminal, and the like. It is also fixed on a limited basis.

On the other hand, in an application program environment for an interactive TV such as a multimedia home platform (MHP), an advanced common application platform (ACAP), an open cable application platform (OCA), and the like, a screen that is generally output through a physical display screen Is assumed to be one.

For example, the application program environment for interactive TV employs a user interface (UI) structure according to the HAVi (Home Audio / Video Interoperability) standard. However, the HAVi UI standard does not limit the number of screens. However, in actual use, it is common to assume that there is only one screen output through the display screen.

In such an environment, a plurality of contents are displayed through a plurality of independent screens, and at the same time, decoding, digital signal processing, user interaction processing, and the like on the contents represented on each screen are performed dynamically, It is difficult to control life-cycle and resource usage on each screen.

Accordingly, there is a need for a method for configuring and providing various contents on a display screen in various ways.

An object of the present invention is to provide an apparatus and method for providing a service through a screen dynamically configured on a physical display screen.

The object of the present invention is not limited to the above-mentioned object, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a multi-screen providing apparatus according to an embodiment of the present invention provides a user / application interface module that receives a mode related to a PiP service operation and a service within a main screen when the input mode is a first mode. And an output module, wherein the video component of is represented and the background video or video component of the service is represented within the PiP screen when the input mode is the second mode.

In order to achieve the above object, the multi-screen providing method according to an embodiment of the present invention (a) receiving a mode for the operation of the PiP service, and the service in the main screen when the input mode is the first mode (B) presenting a video component of and (c) presenting a background video or video component of the service within the PiP screen when the input mode is the second mode.

Specific details of other embodiments are included in the detailed description and the drawings.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims.

Hereinafter, the present invention will be described with reference to a block diagram or a flowchart illustrating a multi-screen providing apparatus and method according to embodiments of the present invention. At this point, it will be understood that each block of the flowchart illustrations and combinations of flowchart illustrations may be performed by computer program instructions. Since these computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, those instructions executed through the processor of the computer or other programmable data processing equipment may be described in flow chart block (s). It will create means to perform the functions. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in the flowchart block (s). Computer program instructions It is also possible to mount on a computer or other programmable data processing equipment, so that a series of operating steps are performed on the computer or other programmable data processing equipment to create a computer-implemented process to create a computer or other programmable data processing equipment. Instructions that perform may also provide steps for performing the functions described in the flowchart block (s).

In addition, each block may represent a portion of a module, segment, or code that includes one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative implementations, the functions noted in the blocks may occur out of order. For example, the two blocks shown in succession may in fact be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the corresponding function.

On the other hand, in order to facilitate the description of the present invention to define the basic concepts related to the present invention.

'Service' is a multimedia content represented by a bundle, and a plurality of service components make up a service.

The 'service component' is a part constituting a service, and includes a video component, an audio component, a data component, and the like. At this time, the data component refers to an application program existing in a service.

'Service context' includes various resources, devices, and execution state information related to executing a service, and includes an object that can control service execution. Indicates.

The 'display display (physical display device)' refers to the physical device (device) in which the contents of the service are actually expressed, the external output port on which the contents of the service are output, or the storage device in which the service is stored. .

An 'display screen' is a screen that is actually output on a display screen, in which any service is set directly on the output screen and represented through the display screen, or at least one logical screen mapped to a certain area of the output screen is displayed. It is output through the screen.

The 'logical screen' is a space in which an arbitrary service is represented and exists virtually only in memory before being mapped to an output screen and is not represented on an actual display screen.

In addition, the logic screen and the output screen may consist of a combination of a background still image, a video ratser and a graphic raster, where the graphic raster is text. ), Lines, colors and images may be synthesized or video frames may be provided in a mixture.

The 'main service' refers to a service selected by the user as a main service through a menu or a remote control displayed on the display screen or by an application through the API, and refers to a screen on which the main service is represented. It is called.

"PiP service" means a service that the user has selected as a subservice within the main screen via a menu or remote control that appears on the display screen or through an API, and the PiP service is a "PiP screen ( Picture-in-Picture screen) 'or the main screen.

'PiP Screen (Picture-in-Picture screen)' is a screen occupying some area in another screen as shown in Figs. 1A to 1D, and in Figs. A screen that is simultaneously shown in an area that does not overlap with another screen as shown, and also overlaps with another screen at any position and area on the display screen as shown in FIGS. 1G and 1H. It may be understood as a concept including a screen to be represented.

2 is an exemplary view showing a relationship between a logic screen and an output screen according to an embodiment of the present invention.

Referring to FIG. 2, a service may be represented through logic screens 210, 212, and 214, which are then mapped and represented by output mappings 220, 222, and 224 by a predetermined mapping block 230. Can be.

In this case, the output screen referred to as 220 is represented by mapping logic screens referred to as 210 and 212, and the output screen referred to as 222 is represented as mapped logical logic screens referred to as 212 and 214, and referred to as 224. The output screen is mapped with the logical screens referred to as 210, 212 and 214.

As such, at least one logical screen on which the service is represented may be mapped to any area of the output screen by the mapping block 230.

Meanwhile, the mapping block 230 may be understood as a collection of various information for mapping the logical screen and the output screen. Examples of such information may include coordinate information of an area where the logical screen is mapped to the output screen, identification information for distinguishing the logical screen from the output screen, information about the order in which the plurality of logical screens are displayed on the output screen, and the like. .

The mapping block 230 may change the size of the logical screen and allocate the same to a predetermined area of the output screen. That is, the mapping block 230 may perform a scaling function and a position allocation function for a logical screen, and FIG. 3A to FIG. 3E illustrate a configuration of a screen including such a mapping block, that is, a mapper. .

Referring to FIG. 3A, a main screen composed of a combination of a background still image (B), a video ratser (V), and a graphic raster (G) is defined by a mapper. It is mapped to the entirety of the output screen while maintaining the size. PiP screens with only video components are mapped to a given area of the output screen as their size is reduced by a mapper. At this point, the mapped PiP screen is placed on the main screen, which is determined by the Z value. Z denotes a z-order value, and the z-order will be described later. In addition, an overlay screen can be composited with the output screen, which is the outermost special screen that can be used, for example, when it is necessary to provide a caption. . The PiP screen may have only video components as in FIG. 3A, but as shown in FIG. 3B, a background still image (B), a video ratser (V), and a graphic raster are shown. It may consist of a combination of (G).

Referring to FIG. 3C, a main screen made up of a combination of background still image (B), video raster (V) and graphic raster (G) is mapped by the mapper to the entirety of the output screen while maintaining its size. The two PiP screens # 1 and # 2 having only the video component are each mapped by a mapper to a certain area of the output screen as their size is reduced. At this time, the mapped PiP screens are placed on the main screen, and the Z value can remain the same. In addition, an overlay screen can be combined with the output screen. The screen configuration may include a plurality of PiP screens having only video components as in FIG. 3C, but as shown in FIG. 3D in a combination of background still image (B), video raster (V) and graphic raster (G). It may also consist of a plurality of PiP screens.

In FIG. 3E, a POP screen is illustrated. If the conventional PiP screen is a screen displayed inside the main screen, the POP screen may be understood as a screen displayed outside the main screen. Referring to FIG. 3E, a plurality of POP screens # 1 and # 2 having a combination of a background still image (B), a video raster (V), and a graphic raster (G) are each sized by a mapper. As it becomes smaller, it is mapped to a region of the output screen. At this time, the Z values of the mapped POP screens # 1 and # 2 may be kept the same. In addition, an overlay screen may be represented by being synthesized with the output screen.

In addition, the mapping block 230 may be implemented as an interface, a function, or the like, which is written and executed in various computer program languages. The mapping block 230 may generate or change a relationship between the logical screen and the output screen using the above information as a parameter.

In addition, the mapping block 230 may be implemented in hardware to perform a mapping function between the logical screen and the output screen.

In the output screen, services provided from various sources may be represented and output through a display screen, which is illustrated in FIG. 4.

Generally, as a source for providing a service, there is a source for providing a broadcast service such as terrestrial broadcasting 320 or cable broadcasting 330, and a service stored in a predetermined storage medium such as a personal video recorder (PVR) 340. There is also a source available. In addition, although not shown in FIG. 4, a source for providing a service through a wired or wireless network may also be included.

At this time, the broadcast receiving device 310 receives a service from these sources, and generates a logical screen representing each service.

Then, according to a preset method, a method set by a user or an application, any service is directly set on the output screen and represented through the display screen, or at least one logical screen mapped to a certain area of the output screen is displayed on the display screen ( Through 350).

 In FIG. 4, the services provided by the terrestrial broadcast 320, the cable broadcast 330, and the PVR 340 are represented through the display screen 350.

In FIG. 4, as an example of a source for providing a service, a terrestrial broadcast 320, a cable broadcast 330, and a personal video recorder (PVR) 340 are illustrated, but a source for providing a service is not limited thereto. If it provides multimedia content represented by a bundle of may be included in the source in the present invention.

Meanwhile, the services of the present invention include an abstract service and a non-abstract service, which are illustrated in FIGS. 5A and 5B, respectively.

An abstract service is an independent service for a broadcast channel, not a service delivered in real time from a broadcast signal. The abstract service is an abstract service that includes only a data component, that is, an application program, without a video component or an audio component. It may correspond to a service. For example, services that consist of unbound applications in the Open Cable Application Platform (OCAP) specification fall into this category.

A non-abstract service can be understood as a service other than an abstract service.

In the present invention, independence may be provided for each of the abstract service and the non-abstract service. For example, the abstract service may be set directly on the output screen without going through the logical screen, and the non-abstract service may be represented on the logical screen and mapped to the output screen on which the abstract service is set. The output screen can then be output via the display screen, whereby the abstract and non-abstract services can be represented independently on one output screen. In addition, both abstract and non-abstract services may be mapped to separate logical screens, and then each logical screen may be mapped to one output screen. In other words, the abstract service and the non-abstract service may be represented on the output screen as independent forms.

Meanwhile, in the present invention, the logical screen and the output screen may be defined as separate objects, but the screen may function as the logical screen or the output screen according to the attribute information of one object called the screen. have.

That is, it is possible to know whether the screen is a logical screen or an output screen through type information among attribute information about the screen object.

As attribute information of the screen object, there are attribute information such as 'Type', 'z-Order', 'Display_Area', 'Visibility', 'Associated_Display_Screen', 'Associated_Service_Contexts', and 'OutputPort'.

6 shows the attribute information of the screen object and the type of interface for processing the attribute information.

'Type' attribute 510 is attribute information indicating whether the screen is a logical screen or an output screen.

The 'z-Order' attribute 520 is for determining the order on the z-axis when the logical screens are represented on the output screen, and in FIG. 7 illustrates how the logical screen appears according to the z-order attribute on the output screen. Doing.

In FIG. 7, the first logical screen 620 and the second logical screen 630 are mapped to a certain area on the output screen 610. At this time, the first logical screen 620 is represented on the output screen, and the second logical screen 630 is represented above it. That is, in the z-axis direction, the output screen 610, the first logical screen 620, and the second logical screen 630 are expressed in the order of the z-order attribute value of the first logical screen 620. With this 1, the z-order attribute value of the second logical screen 620 can be set to 2. At this time, the z-order attribute value can be in any number or character form as long as it indicates the order in which the logical screen is expressed on the z-axis of the output screen.

The 'Display_Area' property 530 indicates information about an area of an output screen to be output by mapping a logical screen to an output screen, which is illustrated in FIGS. 8A and 8B.

FIG. 8A illustrates that the logic screen 710 is mapped to the entire area of the output screen 720 and is output. FIG. 8B illustrates that the logic screen 730 is mapped and output to a partial area of the output screen 740. have.

In this case, the information indicating the 'Display_Area' property may be two-dimensional coordinate information on the output screen, or may be expressed as a specific position on the output screen and an offset value from the specific position.

The 'Visibility' attribute 540 is an attribute that determines whether the logical screen is to be shown on the output screen. By changing the value of this attribute, the logical screen can be made visible or disappeared on the physical display screen.

The 'Associated_Display_Screen' property 550 indicates identification information of output screens associated with the logical screen. Logical screens that are not connected to an output screen are not shown on the display screen or sent to other external outputs.

The 'Associated_Service_Contexts' attribute 560 represents information about service contexts associated with the logical screen or output screen itself, with the service set in the service context being represented on the logical screen or output screen.

The 'OutputPort' attribute 570 indicates information about an object on which an output screen is output, and may include a display screen, a wired / wireless communication medium, and various storage media as the object on which the output screen is output.

Meanwhile, interfaces for acquiring or changing the value of the attribute information shown in FIG. 6 may be provided, as shown in FIG. 6, setting a value of the attribute information or connecting a logical screen to an output screen. 'Set' interface to add the value of the property information or 'add' interface to connect the logical screen with the service, 'get' interface to get the value of the property information, '' to delete the value of the property information remove 'interface. Such an interface may be understood as a process, a function, a procedure, a method, or the like that performs each function.

For example, the 'getDisplayScreen (void)' method functions to return an output screen associated with the current screen. For example, if the current screen is a logical screen, the associated output screen is returned. If the current screen is an output screen, reference information about the current screen is returned. If the current screen is a logical screen but no associated output screen exists. Returns null.

As another example, the 'public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException' method provides the ability to map the current logical screen to a given area of the associated output screen. The instance provided as a parameter is a 'HScreenRectangle' class type of the 'org.havi.ui' package and has two-dimensional location information. As an exception for the 'setDisplayArea (HScreenRectangle rect)' method, an 'SecurityException' exception and an 'IllegalStateException' exception may be performed. An 'IllegalStateException' exception may be performed if the current screen is not a logical screen, or if the area of the output screen associated with the current logical screen cannot be changed due to the nature of the hardware or software platform.

As another example, the 'getOutputArea (void)' method returns information about the current screen area in the form of the 'HScreenRectangle' class. If the current screen is an output screen, 'HScreenRectangle' information having the same value as 'HScreenRectangle (0,0,1,1)' is returned. If the current screen is a logical screen, the associated output screen is returned. Information about the area occupied by the logical screen is returned. If the current screen is a logical screen but there is no associated output screen, then a NULL value is returned.

Each interface name mentioned above is merely a name for indicating each function, and should not be limited to the name but should be understood as the function.

9 is an exemplary diagram illustrating a process in which two services are respectively set in two logical screens and mapped and output in one output screen.

Referring to FIG. 9, the first service is a service in which all three service components of video / audio / data exist, and the second service is an example in which only a video component and an audio component exist. Of course, the present invention does not place any restrictions on the service component, and FIG. 9 shows one possible example.

As shown in FIG. 9, the first service and the second service appear on the display screen in a similar manner to the conventional method, but according to the present invention, a plurality of services can be applied to the display screen without any number through mapping. Can be expressed independently in various positions.

10 is a block diagram showing the configuration of a multi-screen providing apparatus according to an embodiment of the present invention.

Referring to FIG. 10, the multi-screen providing apparatus 900 according to the present invention includes a digital signal processing module 940, a service processing module 950, an output module 960, and a user / application interface module 965. .

In this case, a source for supplying a service may include a broadcast signal receiving module 910, a storage medium 920, or an external input module 930, and a display screen 970 as a medium for outputting a service. ), A storage medium 980, or an external output module 990.

In this case, the term 'module' used in the present embodiment refers to software or a hardware component such as an FPGA or an ASIC, and a module plays a role. However, modules are not meant to be limited to software or hardware. The module may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a module may include components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, subroutines. , Segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules. In addition, the components and modules may be implemented to play one or more CPUs in a device or secure multimedia card.

The digital signal processing module 940 includes various configuration information constituting a service such as multimedia content from the broadcast signal receiving module 910, the storage medium 920, or the external input module 930, for example, video information and audio information. Or data information or the like.

In this case, the broadcast signal receiving module 910 is a module for receiving and transmitting satellite, terrestrial or cable broadcast signals, and the storage medium 920 represents a device storing video information, audio information, or data information constituting a service. The external input module 930 may be understood as a module that receives and transmits video information, audio information, or data information constituting a service from another networked device such as a network interface module.

The digital signal processing module 940 restores a service by using the received service components, and may restore a plurality of services. At this time, the restored service includes an abstract service or a non-abstract service.

In addition, the term 'plural services' may mean, for example, two or more services delivered by the broadcast signal receiving module 910, and may be delivered from each of the broadcast signal receiving module 910 and the storage medium 920. It may mean two or more services.

The service restored by the digital signal processing module 940 may be restored according to the selection of a user or an application through the user / application interface module 965. At this time, the user or the application may select which service to connect to which screen.

The service processing module 950 generates a logical screen and an output screen for representing the service restored by the digital signal processing module 940.

The output module 960 maps and outputs the logical screens generated by the service processing module 950 to a predetermined area on the output screen. At this point, the mapping onto the output screen may already be set or may be set by the user or application via the user / application interface module 965.

In addition, the service restored by the digital signal processing module 940 may be directly connected to the output screen instead of the logical screen in the service processing module 950 and output by the output module 960.

The output screen by the output module 960 may be output through the physical display screen 970 or may be stored in the storage medium 980. The storage medium 980 can be read by a computer and includes a floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, Blu-ray Disc (BD) and semiconductor memory.

Also, it may be delivered to another device connected through a network through the external output module 990.

To this end, the output module 960 may comprise a number of output ports on which an output screen is provided, in which case the default output port already set or an output port designated via the user / application interface module 965. Through the output screen can be provided.

The user or application may allow the user / application interface module 965 to select or restore a desired service. In addition, the user or application may select any of the plurality of output screens via the user / application interface module 965.

Since each module illustrated in FIG. 10 is shown separately according to each function, the modules may be combined with other modules in an actual implementation.

11 is a flowchart illustrating a method of providing a service through multiple screens dynamically configured according to an embodiment of the present invention.

In general, video information, audio information, data information, etc. constituting multimedia content are delivered according to a predetermined format such as, for example, an MPEG stream. Therefore, the device executing the service such as the multimedia content receives the above information and restores the corresponding service (S1010). At this time, the service to be restored may be selected or preset by the user or the application. The user can select which service to connect to which screen by using a menu or remote control displayed on the display screen or by using an API.

Meanwhile, the data information includes application information about an application program existing in the service, and the application information includes signal information indicating whether the application program can be executed on the PiP screen. Examples of the application information include an application information table (AIT) according to the MHP standard and an eXtended Application Information Table (XAIT) according to the OCAP standard, and the signal information may be added to the application information.

Then, the restored service is set to be represented on the logical screen according to the present invention (S1020), the logical screen is mapped to the output screen according to the present invention (S1030), and then through a display screen, a storage medium or a network. The output screen is provided (S1040).

Meanwhile, although the restored service is represented as being provided through the output screen through the logical screen in FIG. 11, the restored service may be provided through the output screen directly without passing through the logical screen.

Although FIG. 11 illustrates a process in which one service is mapped to an output screen for convenience of description, a plurality of services are mapped to any area within one output screen directly or through a plurality of logical screens using screen attribute information. Can be. Therefore, when the output screen is provided through the display screen, the user or the application can execute a plurality of services.

Meanwhile, when the user or the application selects the PiP service, the multi-screen providing apparatus 900 may express the PiP service in two modes. The first mode is illustrated in FIG. 12A and the second mode is illustrated in FIG. 12B.

12A, in the first mode, no separate logical screen, eg, a PiP screen, for the PiP service is generated, but only a video component of the PiP service selected in the main screen is represented. At this time, in the first mode, the application associated with the PiP service is not executed or its operation is deactivated.

Referring to FIG. 12B, in the second mode, a separate logical screen for the PiP service is generated to represent the selected PiP service in the generated PiP screen. The PiP screen provided in the second mode may include a background video or a video component that serves as a desktop. In addition, unlike the first mode, the application associated with the PiP service may be executed in the second mode. At this time, whether the application can be executed may be determined by the signal information described above.

Preferably, the first mode and the second mode are not performed at the same time.

In addition, the above mode may be selected by a user input or an application through the user / application interface module 965. If the user or the application selects the first mode, the digital signal processing module 940 may select the selected PiP service. Reconstruct only the video component of, and the reconstructed video component is mapped to the main screen generated by the service processing module 950. Then, it is displayed through the output screen generated by the output module 960. If the user or the application selects the second mode, the digital signal processing module 940 restores the selected PiP service, and the restored service is mapped to the PiP screen generated by the service processing module 950. Then, it is displayed through the output screen generated by the output module 960.

13 is an exemplary diagram illustrating a software architecture for providing multiple screens in accordance with an embodiment of the present invention.

Referring to FIG. 13, the software architecture 1100 according to the present invention may include a device driver layer 1110, an application program interface layer 1120, and an application layer 1130. Include.

The device driver layer 1110 receives and decodes service components constituting a service from various sources that provide multimedia content. In this case, examples of the service component include video information, audio information or data information.

The API layer 1120 creates a logical screen and an output screen and performs mapping between services, logical screens, and output screens.

The application layer 1130 may provide a user interface that allows a user to dynamically configure a logical screen on which a service is expressed, or transmit a user's command to the API layer 1120 to perform an operation according to the command. have.

Meanwhile, the user may allow the device driver layer 1110 to output the output screen through a physical display screen or to store it in a storage medium through the application layer 1130. In addition, the device driver layer 1110 may transmit the output screen to another device through a network.

To this end, the device driver layer 1110 may include a plurality of output ports providing the output screen, but a plurality of output ports may be present in the API layer 1120.

Meanwhile, in order to dynamically configure a plurality of logical screens on an output screen, the API layer 1120 may include a plurality of software modules, wherein the 'MultiScreenManager' module, 'MultiScreenContext' module, 'MultiMultiScreencontextListener' module, and ' MultiMultiScreencontextEvent 'module will be described as an example, and the relationship between these modules is shown in FIG.

The 'MultiScreenManager' module 1210 manages the 'MultiScreenContext' module, finds a desired screen, informs device sharing information between the screens, and plays a role of registering or unregistering the 'MultiMultiScreencontextListener' module 1250.

The 'MultiScreenContext' module 1230 is an interface object for the screen object in association with the screen object 1220. The screen type of the screen object may be determined as a logical screen and an output screen according to the interface operation of the 'MultiScreenContext' module 1230. The various attribute information shown in FIG. 6 may be set. The aforementioned 'set', 'add', 'get', and 'remove' interfaces may be provided by the 'MultiScreenContext' module 1230.

The 'MultiMultiScreencontextEvent' module 1240 is an event class for notifying when the property information of the screen object 1220 is changed by the 'MultiScreenContext' interface object 1230, and the 'MultiMultiScreencontextListener' module 1250 A listener interface object that may be implemented in a predetermined application class that wants to receive an event by the 'MultiMultiScreencontextEvent' module 1240.

Meanwhile, the application 1260 is a module operating in the application layer 1130 and allows a user to select a desired service and freely arrange a plurality of logical screens according to a desired form on an output screen.

Thus, if application 1260 communicates commands to MultiScreenManager module 1210 regarding the user's dynamic placement and management of a logical screen, MultiScreenManager module 1210 corresponds to the commands via MultiScreenContext module 1230. Perform the action.

Meanwhile, the MultiScreenContext module 1230 may manage property information of the screen object 1220 illustrated in FIG. 6 in association with the screen object 1220 and may include various functions or methods for such management. .

Meanwhile, although not shown, the MultiScreenManager module 1210 may operate to receive service components provided from various sources from the device driver layer 1110 so that they may be represented on a logical screen or an output screen. Of course, this function may be performed through a separate module (not shown).

FIG. 15 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG. 14.

First, the MultiScreenManager module 1210 generates one output screen and as many logical screens as the number of services to be executed (S1310).

Then, the MultiScreenManager module 1210 connects each logical screen with a service received from the device driver layer 1110 (S1320). At this time, for each logical screen, the 'addServiceContext' method of the logical screen object may be called using the service context object for the service to be connected as a parameter. Here, the 'addServiceContext' method may be understood as a method that performs a function of connecting a logical screen and a service, and may be provided by the MultiScreenContext module 1230.

When the logical screen and the service are connected, the MultiScreenManager module 1210 connects each logical screen with the output screen (S1330). At this time, for each logical screen, the 'setDisplayScreen' method of the logical screen object may be called using the output screen object to be connected as a parameter. Herein, the 'setDisplayScreen' method may be understood as a method that performs a function of connecting a logical screen and an output screen, and may be provided by the MultiScreenContext module 1230.

For example, the 'setDisplayScreen' method can be expressed in the form of 'public void setDisplayScreen (HScreen screen) throws SecurityException, IllegalStateException', which associates the provided 'HScreen' instance with the current logical screen. To provide. In this case, the 'HScreen' instance is preferably an output screen.

The parameter of the 'setDisplayScreen (HScreen screen)' method may include 'NULL'. In this case, when the 'setDisplayScreen (HScreen screen)' method is executed without exception handling, the current logical screen is no longer present. It is not associated with an output screen.

As an exception for the 'setDisplayScreen (HScreen screen)' method, an 'SecurityException' exception and an 'IllegalStateException' exception may be performed.

An 'IllegalStateException' exception can be used to associate the current logical screen with an output screen corresponding to that parameter because the current screen is not a logical screen or an output screen provided as a parameter due to the nature of the hardware or software platform is associated with a particular logical screen. May be performed if none.

When a service and a logical screen, and a plurality of logical screens and one output screen are connected, an area of an output screen on which each logical screen is to be represented is set (S1340). At this time, for each logical screen, a method provided by the MultiScreenContext module 1230 may be called to set an area to be displayed on the output screen.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

According to the present invention, the service obtained from the cable, satellite, terrestrial broadcasting, various storage media, external input, etc. can be represented in various forms through a physical display screen.

Claims (10)

A user / application interface module configured to receive a mode related to a PiP service operation; And An output module in which a video component of a service is represented in a main screen when the input mode is a first mode, and a background video or video component of a service is represented in a PiP screen when the input mode is a second mode. Multi-screen providing device comprising a. The method of claim 1, And the application associated with the service is not executed when the input mode is the first mode. The method of claim 2, And the application associated with the service is executed when the input mode is the second mode. The method of claim 3, wherein The apparatus for providing multiple screens, wherein the execution of the application is determined by signal information. The method of claim 1, And the first mode and the second mode are not simultaneously executed. (A) receiving a mode related to a PiP service operation; (B) presenting a video component of a service in a main screen when the input mode is a first mode; And And (c) presenting a background video or video component of the service in the PiP screen when the input mode is the second mode. The method of claim 6, The step (b) further comprises the step of not running the application associated with the service. The method of claim 6, The step (c) further comprises the step of executing an application associated with the service. The method of claim 8, The method of providing a multi-screen is determined whether the application can be executed by the signal information. The method of claim 6, And the first mode and the second mode are not performed simultaneously.

Images