KR100846790B1 - Apparatus for providing multiple screens and method for dynamic configuration of the same - Google Patents

Abstract

The present invention relates to an apparatus for providing multiple screens and a method for dynamically configuring the multiple screens, and in order to dynamically configure a plurality of screens providing a plurality of contents on a physical display screen, And to a method for dynamically configuring the multiple screens. ≪ RTI ID = 0.0 > [0002] < / RTI >

An apparatus for providing multiple screens according to an embodiment of the present invention includes a service processing module for generating a screen for expressing a received service and an output module for searching an output port connected to the screen.

Multi screen, Logical screen, Output screen, OCAP, Port

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for providing multiple screens and a method for dynamically configuring the multiple screens.

FIG. 1 is a diagram illustrating an example in which a PiP screen is disposed according to an embodiment of the present invention.

2 is an exemplary diagram illustrating a relationship between a logical screen and an output screen according to an embodiment of the present invention.

3A to 3E are views showing the configuration of a screen including a mapper according to an embodiment of the present invention.

4 is an exemplary diagram illustrating an example of a source providing a service according to an embodiment of the present invention.

5A and 5B are diagrams illustrating an example of an abstract service and a non-abstract service according to an embodiment of the present invention.

6 is an exemplary diagram showing attribute information and interface types in a logical screen and an output screen.

Figure 7 is an exemplary diagram illustrating the 'z-order' attribute of a logical screen.

8A and 8B are exemplary diagrams showing the 'Display_Area' attribute of the logical screen.

FIG. 9 is an exemplary diagram illustrating a process in which two services are mapped to one output screen and output.

10 is a block diagram illustrating a configuration of an apparatus for providing multiple screens according to an embodiment of the present invention.

11A-11B are flow charts illustrating a method for dynamically configuring multiple screens in accordance with an embodiment of the present invention.

Figure 12 is an exemplary diagram illustrating a software architecture for providing multiple screens in accordance with an embodiment of the present invention.

13 is an exemplary diagram showing the relationship of modules constituting an API layer according to an embodiment of the present invention.

FIG. 14 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by the respective modules shown in FIG.

15 is an exemplary view showing the operation of the output module according to the embodiment of the present invention.

16A to 16B are exemplary views of codes for output port search and change according to an embodiment of the present invention.

FIG. 17 is a flowchart illustrating a process of exchanging services represented on a logical screen by the respective modules shown in FIG.

DESCRIPTION OF THE REFERENCE NUMERALS

900: Multi-screen device

910: Broadcast signal receiving module

920: Storage medium

930: External input module

940: Digital Signal Processing Module

950: service processing module

960: Output module

965: User / Application Interface Module

970: Display screen

980: Storage medium

990: External output module

The present invention relates to an apparatus for providing multiple screens and a method for dynamically constructing the multiple screens, and more particularly, to a method for dynamically configuring a plurality of screens providing a plurality of contents on a physical display screen, To a plurality of different output ports, and to a method for dynamically configuring the multiple screens.

In a conventional broadcast receiving apparatus such as a digital TV or a digital set-top box, only one piece of content is displayed on one physical display screen, or two pieces of main screen and sub-screen are displayed on one physical display screen It is common to show the screen at the same time.

At this time, even if the main screen and the sub screen are displayed at the same time, only two screens can be arranged in a predetermined manner in the broadcast receiving apparatus. All the elements (video, audio, data or a combination thereof) constituting the content are reproduced only in the case of the content shown on the main screen, and only a part of the constituent elements constituting the content is reproduced in a limited manner through the sub-screen.

In addition to broadcasting services such as satellite broadcasting, terrestrial broadcasting and cable broadcasting, there are a storage medium such as a DVD or an external device connected to an external input terminal as a source for providing contents. And whether or not it will be displayed.

On the other hand, in an application program environment for an interactive TV such as a MHP (Multimedia Home Platform), an ACAP (Advanced Common Application Platform), and an OCAP (Open Cable Application Platform) Is assumed to be one.

For example, in an application program environment for an interactive TV, a structure of a user interface (UI) according to the HAVi (Home Audio / Video Interoperability) standard is adopted. In the HAVi UI standard, In actual use, however, it is usually assumed that there is only one screen output through the display screen.

In such an environment, a plurality of contents are displayed on a plurality of independent screens, and at the same time, decoding, digital signal processing, user interaction processing, and the like are performed on the contents displayed on each screen, It is difficult to control life-cycle and resource usage on a screen-by-screen basis.

Accordingly, there is a need for a method of constructing and providing various contents on a display screen in various ways.

An object of the present invention is to connect a plurality of screens to a plurality of different output ports in order to dynamically configure a plurality of screens to provide a plurality of contents on a physical display screen.

The objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, an apparatus for providing multiple screens according to an embodiment of the present invention includes a service processing module for generating a screen for expressing a received service, and an output module for searching an output port connected to the screen .

An apparatus for providing multiple screens according to an exemplary embodiment of the present invention includes a service processing module for generating a screen for expressing a received service, and an output module for changing a connection relationship between the screen and an output port connected to the screen.

A method for dynamic configuration of multiple screens according to an embodiment of the present invention includes generating a screen for representing a received service and searching for an output port connected to the screen.

A method for dynamic configuration of multiple screens according to an exemplary embodiment of the present invention includes generating a screen for representing a received service and changing a connection relationship between an output port connected to the screen and the screen.

The details of other embodiments are included in the detailed description and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described with reference to block diagrams or process flowcharts for explaining an apparatus for providing multiple screens and dynamically configuring the multiple screens according to embodiments of the present invention. At this point, it will be appreciated that the combinations of blocks and flowchart illustrations in the process flow diagrams may be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, so that those instructions, which are executed through a processor of a computer or other programmable data processing apparatus, Thereby creating means for performing functions. These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory The instructions stored in the block diagram (s) are also capable of producing manufacturing items containing instruction means for performing the functions described in the flowchart block (s). The computer program instructions It is also possible to mount on a computer or other programmable data processing equipment, so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer-executed process to perform a computer or other programmable data processing equipment May also provide steps for performing the functions described in the flowchart block (s).

In addition, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative implementations, the functions mentioned in the blocks may occur out of order. For example, two blocks shown in succession may actually be executed substantially concurrently, or the blocks may sometimes be performed in reverse order according to the corresponding function.

In order to facilitate the description of the present invention, a basic concept related to the present invention will be defined.

A 'service' is a multimedia content represented by a bundle, and a plurality of service components form a single service.

A 'service component' is a part of a service and includes a video component, an audio component, a data component, and the like. In this case, a data component refers to an application existing in a service.

In addition, an application can be distinguished as an unbound application and a service bound application. Since the unbound application is not associated with a particular channel, the execution of the application is not affected by channel switching. In addition, since they generally have a high priority, resources for execution are allocated smoothly. A monitor application is a special unbound application that can have the highest priority.

On the other hand, a service-bound application is associated with a transport stream and is generally given a lower priority than an unbound application. Service bound applications do not perform critical system functions and are more likely to give up allocation of resources than unbound applications when there is competition for resources. The service-bound application has an interworking type that works in conjunction with the stream currently being transmitted and a non-interworking type that operates irrespective of the stream being transmitted.

A service context includes various resources related to execution of a service, a device, execution status information, and the like. The service context includes an object that can control the execution of a service .

A 'physical display device' refers to a physical device in which contents of a service are actually represented, an external output port through which contents of the service are output, or a storage device in which services are stored .

An 'output screen' is a screen that is actually output on a display screen, in which arbitrary services are directly set on the output screen and are represented on the display screen, or at least one logical screen mapped to a certain area of the output screen is displayed And is output through the screen.

A 'logical screen' is a space in which an arbitrary service is represented, and is virtually present only in the memory before being mapped to the output screen, and is not displayed on the actual display screen.

The logical screen and the output screen may also be composed of a combination of a background still image, a video raster and a graphic raster, wherein the graphic raster is text (text) A line, a color, and an image may be synthesized, or a mixture of video frames may be provided.

The 'main service' means a service selected by the user as a main service through a menu displayed on a display screen or a remote control or an application via an API. A 'main screen' .

'Picture-in-Picture service' refers to a service selected by a user through a menu displayed on a display screen or a remote control or an application as a sub service in the main screen through an API, and the PiP service is a 'PiP screen Picture-in-Picture screen 'or on the main screen.

The 'Picture-in-Picture screen' includes a screen occupying a partial area in another screen as shown in FIGS. 1 (a) to 1 (d) And a screen that is simultaneously displayed in an area that does not overlap with other screens as shown in the figure and is displayed in an arbitrary position and area within the display screen as shown in Figs. 1 (g) and 1 (h) It can be understood as a concept including a screen which is expressed by overlapping another screen.

2 is an exemplary diagram illustrating a relationship between a logical screen and an output screen according to an embodiment of the present invention.

2, a service may be represented by logical screens 210, 212, 214, which are mapped to output screens 220, 222, 224 by a given mapping block 230, .

At this time, an output screen 220 is represented by mapping a logical screen 210 and 212, and an output screen 222 is represented by a logical screen 212 and 214, The output screen is represented by mapping the logical screen 210, 212, and 214 to each other.

As such, at least one logical screen in which the service is represented may be mapped to any area of the output screen by the mapping block 230.

On the other hand, the mapping block 230 can be understood as a collection of various information for mapping the logical screen and the output screen. Examples of such information may include coordinate information of an area to which the logical screen is mapped to the output screen, identification information to distinguish the logical screen and the output screen, information on the order in which a plurality of logical screens are represented on the output screen, .

The mapping block 230 may change the size of the logical screen and allocate it to a certain area of the output screen. That is, the mapping block 230 shows a configuration of a screen including such a mapping block, i.e., a mapper, in FIGS. 3A to 3E capable of performing a scaling function and a position allocation function for a logical screen .

3A, a main screen made up of a combination of a background still image B, a video raster V, and a graphic raster G is displayed by a mapper It is mapped to the entire output screen, keeping the size intact. A PiP screen having only a video component is mapped to a certain area of the output screen by a mapper. At this time, the mapped PiP screen is placed on the main screen, which is determined by the Z value. Z represents a z-order value, and the z-order will be described later. An overlay screen may also be combined with the output screen, which is a special screen that is placed on the outermost surface, for example when it is necessary to provide a caption. The PiP screen may have only a video component as shown in FIG. 3A, but a background still image B, a video raster V, and a graphic raster, as shown in FIG. 3B, (G).

Referring to FIG. 3C, a main screen made up of a combination of a background still image B, a video raster V and a graphic raster G is mapped to the entire output screen while being kept in size by a mapper. The two PiP screens (# 1, # 2) having only video components are mapped to a certain area of the output screen as their sizes are reduced by a mapper, respectively. At this time, the mapped PiP screens are placed on the main screen, where the Z values can be kept the same. Also, an overlay screen may be combined with the output screen. The screen configuration may include a plurality of PiP screens having only video components as in FIG. 3C, but may be a combination of a background still image B, a video raster V, and a graphic raster G as shown in FIG. 3D A plurality of PiP screens may be formed.

In Fig. 3E, a POP screen is shown. If a PiP screen is a screen represented inside the main screen, it can be understood that a conventional POP screen is a screen displayed outside the main screen. 3E, a plurality of POP screens # 1 and # 2 made up of a combination of a background still image B, a video raster V and a graphic raster G are respectively enlarged by a mapper Is mapped to a certain area of the output screen. At this time, the Z values of the mapped POP screens (# 1, # 2) can be kept the same. An overlay screen may then be combined with the output screen and rendered.

The mapping block 230 may be implemented as an interface, a function, or the like, which is written and executed in various computer program languages. The mapping block 230 may generate or change the relationship between the logical screen and the output screen using the above information as parameters.

The mapping block 230 may also be implemented in hardware to perform a mapping function between the logical screen and the output screen.

In the output screen, services provided from various sources can be expressed and output through a display screen, as shown in FIG.

In general, there are a source for providing a broadcast service such as a terrestrial broadcast 320 and a cable broadcast 330 as a source for providing a service, and a service stored in a predetermined storage medium such as a PVR (Personal Video Recorder) There is also a source to provide. Although not shown in FIG. 4, sources that provide services through a wired or wireless network may also be included herein.

At this time, the broadcast receiving apparatus 310 receives a service from these sources and generates a logical screen representing each service.

Then, any service may be directly set on the output screen and displayed through the display screen 350 according to a predetermined method, a method set by the user or the application, or may be expressed in at least one logical screen Is displayed on the display screen (350). 4 shows that a service provided by the terrestrial broadcast 320, the cable broadcast 330, and the PVR 340 is displayed on the display screen 350. [

4 shows a terrestrial broadcast 320, a cable broadcast 330, and a personal video recorder (PVR) 340 as an example of a service providing source. However, the source for providing the service is not limited to this, The present invention can be included in the source of multimedia contents.

In the meantime, the service of the present invention includes an abstract service and a non-abstract service, which are shown in FIGS. 5A and 5B, respectively.

An abstract service is an independent service for a broadcast channel, not a real-time service transmitted from a broadcast signal. The service includes a video component, an audio component, and a data component, . ≪ / RTI > For example, here is a service made up of unbound applications in the Open Cable Application Platform (OCAP) specification.

A non-abstract service can be understood as a service other than an abstract service.

In the present invention, independence can be given to each abstract service and non-abstract service. For example, the abstract service may be set directly on the output screen without going through the logical screen, and the non-visual service may be mapped to the output screen where the abstract service is rendered on the logical screen. Then, the output screen can be output through the display screen, so that the abstract service and the non-abstract service can be independently expressed on one output screen. In addition, each of the abstract service and non-local service may be mapped to a separate logical screen, and then each logical screen may be mapped to a single output screen. In other words, the abstract service and the non-abstract service can be represented on the output screen as independent forms.

The logical screen and the output screen in the present invention may be defined as separate objects, but depending on the property information of one object 'screen', the 'screen' may function as a logical screen or an output screen have.

That is, it is possible to know whether the screen is a logical screen or an output screen through type information among attribute information about the screen object.

Attributes such as 'Type', 'z-order', 'Display_Area', 'Visibility', 'Associated_Display_Screen', 'Associated_Service_Contexts', 'OutputPort'

6 shows the attribute information of the screen object and the types of interfaces for processing these attribute information.

The 'Type' attribute 510 is attribute information indicating whether the screen is a logical screen or an output screen.

The 'z-order' attribute 520 is for determining the order on the z-axis when the logical screens are rendered on the output screen, and FIG. 7 illustrates how the logical screen is displayed according to the z- .

In FIG. 7, the first logical screen 620 and the second logical screen 630 are mapped on a predetermined area on the output screen 610. At this time, the first logical screen 620 is represented on the output screen, and the second logical screen 630 is represented thereon. That is, in the z-axis direction, the output screen 610, the first logical screen 620, and the second logical screen 630 are represented in this order. In this case, the z-order attribute value of the first logical screen 620 With this one, the z-order attribute value of the second logical screen 620 can be set to two. In this case, the z-order attribute value can be any number or character type, as long as the information indicates the order in which the logical screen is represented on the z-axis of the output screen.

The 'Display_Area' attribute 530 indicates information on the area of the output screen where the logical screen is mapped to the output screen, which is illustrated in FIGS. 8A and 8B.

8A shows that the logical screen 710 is mapped to the entire area of the output screen 720 and FIG. 8B shows that the logical screen 730 is mapped and output to a partial area of the output screen 740 have.

At this time, the information indicating the 'Display_Area' attribute 530 may be expressed as two-dimensional coordinate information on the output screen, or as a specific position on the output screen and an offset value from the specific position.

The 'Visibility' attribute 540 is an attribute that determines whether or not a logical screen is to be displayed on the output screen, by changing the value of this property, the logical screen can be made visible or disappear on the physical display screen.

The 'Associated_Display_Screen' property 550 indicates identification information of output screens connected to the logical screen. Logical screens that are not connected to the output screen are not shown on the display screen or sent to other external outputs.

The 'Associated_Service_Contexts' attribute 560 indicates information about the service contexts associated with the logical screen or the output screen itself, wherein the services set in the service context are represented on a logical screen or an output screen.

The 'OutputPort' attribute 570 indicates information about an object to which the output screen is output. The output screen may include a display screen, a wired / wireless communication medium, various storage media, and the like.

Meanwhile, interfaces for recognizing or changing the values of the attribute information shown in FIG. 6 may be provided. For example, as shown in FIG. 6, values of attribute information may be set or a logical screen may be connected to an output screen An 'add' interface for adding a value of property information or connecting a logical screen to a service, a 'get' interface for obtaining a value of property information, a ' remove 'interface. These interfaces can be understood as processes, functions, procedures, and methods that perform each function.

For example, the 'getDisplayScreen (void)' method returns the output screen associated with the current screen. For example, if the current screen is a logical screen, the associated output screen is returned; if the current screen is an output screen, reference information for the current screen is returned; if the current screen is a logical screen but no associated output screen 'NULL' is returned.

As another example, the 'public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException' method provides the ability to map the current logical screen to a given area of the associated output screen. The parameterized instance is the 'HScreenRectangle' class type in the 'org.havi.ui' package, which has two-dimensional location information. The 'SecurityException' exception and the 'IllegalStateException' exception can be performed as exception handling for the 'setDisplayArea (HScreenRectangle rect)' method above. An 'IllegalStateException' exception may be thrown if the current screen is not a logical screen, or because the nature of the hardware or software platform can not change the area of the output screen associated with the current logical screen.

As another example, the 'getDisplayArea (void)' method returns information about the area of the current screen in the form of the 'HScreenRectangle' class. If the current screen is an output screen, it returns 'HScreenRectangle' information having the same value as 'HScreenRectangle (0,0,1,1)', and if the current screen is a logical screen, Information about the area occupied by the logical screen is returned. And, if the current screen is a logical screen but there is no associated output screen, a value of 'NULL' is returned.

Each of the above-mentioned interface names is only a name for showing each function, and thus should be understood as its function, not limited to the name.

9 is an exemplary diagram illustrating a process in which two services are set on two logical screens and mapped to one output screen and output.

Referring to FIG. 9, the first service is a service in which all three service components of video / audio / data exist, and the second service is an example in which only a video component and an audio component exist. Of course, the present invention does not limit the service component, and FIG. 9 shows one possible example.

As shown in FIG. 9, the first service and the second service are displayed on the display screen in a similar manner to the conventional method. However, according to the present invention, a plurality of services It can be expressed independently at various locations.

10 is a block diagram illustrating a configuration of an apparatus for providing multiple screens according to an embodiment of the present invention.

10, a multi-screen providing apparatus 900 according to the present invention includes a digital signal processing module 940, a service processing module 950, an output module 960, and a user / application interface module 965 do.

In this case, a source for providing the service may include a broadcast signal receiving module 910, a storage medium 920, or an external input module 930, , A storage medium 980, or an external output module 990.

Here, the term " module " used in this embodiment means a hardware component such as software or an FPGA or an ASIC, and the module performs certain roles. However, a module is not limited to software or hardware. A module may be configured to reside on an addressable storage medium and configured to play back one or more processors. Thus, by way of example, a module may include components such as software components, object-oriented software components, class components and task components, and processes, functions, attributes, procedures, Microcode, circuitry, data, databases, data structures, tables, arrays, and variables, as will be appreciated by those skilled in the art. The functionality provided within the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules. In addition, the components and modules may be implemented to play back one or more CPUs in a device or a secure multimedia card.

The digital signal processing module 940 receives various configuration information for configuring a service such as multimedia contents from the broadcast signal receiving module 910, the storage medium 920 or the external input module 930, for example, Information or data information.

At this time, the broadcast signal receiving module 910 is a module for receiving and delivering satellite, terrestrial, or cable broadcast signals, and the storage medium 920 represents a device in which video information, audio information, data information, And the external input module 930 may be understood as a module for receiving video information, audio information, data information, or the like constituting a service from another device connected to the network, such as a network interface module.

The digital signal processing module 940 restores the service using the received service components, and can restore a plurality of services at this time. At this time, the restored service includes an abstract service or an invisible service.

The plurality of services may be two or more services transmitted from the broadcast signal receiving module 910 and may be transmitted from the broadcast signal receiving module 910 and the storage medium 920, Or two or more services that are < / RTI >

The service restored in the digital signal processing module 940 may be restored according to the selection of the user or application through the user / application interface module 965. [ At this time, the user or application can select which service to connect to which screen.

The service processing module 950 generates a logical screen and an output screen for expressing the service restored by the digital signal processing module 940.

The output module 960 maps and outputs the logical screens generated by the service processing module 950 to a predetermined area on the output screen. At this time, the mapping onto the output screen may already be set or may be set by the user or application via the user / application interface module 965. [

In addition, the service restored by the digital signal processing module 940 may be output by the output module 960 directly to the output screen without being connected to the logical screen at the service processing module 950.

The output module 960 may output the output screen through the physical display screen 970 or may be stored in the storage medium 980. Here, the storage medium 980 is a computer-readable and includes a floppy disk, a hard disk, a CD-ROM, a DVD, a DVD-ROM, a Blu-ray Disc (BD)

It may also be delivered to another device connected to the network via the external output module 990.

To this end, the output module 960 may include a plurality of output ports to which an output screen is provided, in which case, through a pre-established basic output port or user / application interface module 965, An output screen may be provided.

Here, the output module 960 may retrieve the output port associated with the screen. That is, one of the screens generated by the service processing module 950 is searched for an output port connected to a specific screen.

The screen retrieved by the output module 960 includes at least one of a logical screen on which the application included in the service is executed and an output screen on which the logical screen is mapped.

In addition, the output screen retrieved by the output module 960 may be a screen to which the logical screen on which the application is executed is mapped, or may be a screen on which the application is directly executed without mapping the logical screen.

The output module 960 may generate at least one output port for one screen and map it to the screen. In other words, the user or application may transmit the content contained in the screen to the display screen 970, the storage medium 980 or the external output module 990 via the user / application interface module 965, ) Can create output ports for each path separately and map them to the screen.

In addition, the output module 960 may change the connection relationship between the screen and the output port connected to the screen. For example, in a state that the first screen and the first output port are mapped and the second screen and the second output port are mapped, the output module 960 outputs the first screen 2 output port and the second screen to the first output port.

The user or application can select or restore the desired service through the user / application interface module 965. [ In addition, a user or an application may select any output screen among a plurality of output screens through the user / application interface module 965. [

Since each of the modules shown in FIG. 10 is separately shown according to each function, in actual implementation, it is possible to combine with other modules.

11A is a flow chart illustrating a method for dynamically configuring multiple screens in accordance with one embodiment of the present invention.

In general, video information, audio information, data information, and the like constituting multimedia contents are delivered according to a predetermined format such as an MPEG stream, for example. Therefore, the device executing the service such as the multimedia contents receives the above information and restores the corresponding service (S1010). At this time, the restored service can be selected or preset by the user or the application. The user can select which services to connect to which screen using the menu displayed on the display screen or the remote control or the application using the API.

On the other hand, the data information includes application information related to an application existing in the service, and the application information includes signal information indicating whether or not the application can be executed on the PiP screen. Examples of the application information include an application information table (AIT) according to the MHP standard and an extended application information table (XAIT) according to the OCAP standard, and the signal information can be added to the application information.

Then, the restored service is set to be represented in the logical screen according to the present invention (S1020), the logical screen is mapped to the output screen according to the present invention (S1030), and then the display screen, The output screen is provided (S1040).

11B is a flowchart specifically illustrating a process of providing an output screen. The output module 960 may search for an output port connected to the output screen (S1050) or change the output port according to a control command of a user or an application (S1060) . That is, when a control command for searching for an output port is inputted from a user or an application, the output module 960 searches for an output port connected to the current output screen, and when a control command for changing the output port is inputted, You can change the connection by connecting the output port connected to the current screen to another output port.

11A to 11B, the restored service is expressed as being provided through an output screen via a logical screen, but may also be provided through a direct output screen without going through a logical screen.

In addition, when the user selects the PiP service, the PiP service can be expressed as two modes. In the first mode, a separate logical screen for the PiP service, for example, a PiP screen is not generated, In the second mode, a separate logical screen for the PiP service is generated and the selected PiP service is displayed in the generated PiP screen.

11A to 11B illustrate a process in which one service is mapped to an output screen for the sake of convenience of description. However, it is also possible that a plurality of services may be displayed on a plurality of logical screens or directly on one output screen And can be mapped to arbitrary regions.

Accordingly, when an output screen is provided through the display screen, the user or the application can execute a plurality of services.

Figure 12 is an exemplary diagram illustrating a software architecture for providing multiple screens in accordance with an embodiment of the present invention.

12, the software architecture 1100 according to the present invention includes a device driver layer 1110, an API layer 1120, and an application layer 1130 .

The device driver layer 1110 receives and decodes service components constituting a service from various sources providing multimedia contents. At this time, examples of service components include video information, audio information, or data information.

The API layer 1120 generates a logical screen and an output screen, and performs a mapping between the service, the logical screen, and the output screen.

The application layer 1130 may provide a user interface that allows the user to dynamically configure the logical screen on which the service is represented or may transmit a user's command to the API layer 1120 to perform an operation in accordance with the command have.

Meanwhile, the user can cause the device driver layer 1110 to output the output screen through the physical display screen or store the output screen on the storage medium through the application layer 1130. [ In addition, the device driver layer 1110 may transmit the output screen to another device via the network.

To this end, the device driver layer 1110 may include a plurality of output ports for providing the output screen, but a plurality of output ports may exist in the API layer 1120. [

In order to dynamically configure a plurality of logical screens on the output screen, the API layer 1120 may include a plurality of software modules, in which a 'MultiScreenManager' module, a 'MultiScreenContext' module, a 'MultiScreenContextListener' MultiScreenContextEvent 'module as an example, and the relationship between these modules is shown in FIG.

The 'MultiScreenManager' module 1210 manages the 'MultiScreenContext' module, finds a desired screen, informs device sharing information between screens, and plays a role of registering or releasing the 'MultiScreenContextListener' module 1250.

The 'MultiScreenContext' module 1230 is an interface object for a screen object in association with the screen object 1220, and the screen object is determined as the logical screen and the output screen according to the interface operation of the 'MultiScreenContext' module 1230 And various attribute information shown in Fig. 6 can be set. The aforementioned 'set', 'add', 'get', and 'remove' interfaces may be provided by the 'MultiScreenContext' module 1230.

The 'MultiScreenContextEvent' module 1240 is an event class for notifying when the attribute information of the screen object 1220 is changed by the 'MultiScreenContext' interface object 1230 and the 'MultiScreenContextListener' module 1250 Is a listener interface object that can be implemented in a predetermined application class to receive an event by the 'MultiScreenContextEvent' module 1240.

Meanwhile, the application 1260 is a module operating in the application layer 1130, allowing a user to select a desired service and freely arranging a plurality of logical screens on an output screen according to a desired form.

Thus, if the application 1260 passes commands to the MultiScreenManager module 1210 about dynamically arranging and managing the logical screen to the user, the MultiScreenManager module 1210 sends a command to the MultiScreenManager module 1210, via the MultiScreenContext module 1230, To perform an operation.

Meanwhile, the MultiScreenContext module 1230 can manage the property information of the screen object 1220 shown in FIG. 6 in association with the screen object 1220 and can include various functions or methods for such management .

Meanwhile, according to an embodiment of the present invention, the MultiScreenManager module 1210 may receive service components provided from various sources from the device driver layer 1110 and may operate to be expressed in a logical screen or an output screen. Of course, this function may also be performed through a separate module, not shown.

FIG. 14 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by the respective modules shown in FIG.

First, the MultiScreenManager module 1210 generates one output screen and a number of logical screens corresponding to the number of services to be executed (S1310).

Then, the MultiScreenManager module 1210 associates each logical screen with the service received from the device driver layer 1110 (S1320). At this time, for each logical screen, the 'addServiceContext' method of the logical screen object can be called with the service context object for the service to be connected as a parameter. Here, the 'addServiceContext' method can be understood as a method performing the function of connecting the logical screen and the service, and can be provided by the MultiScreenContext module 1230.

When the logical screen and the service are connected, the MultiScreenManager module 1210 connects each logical screen with the output screen (S1330). At this time, for each logical screen, the 'setDisplayScreen' method of the logical screen object can be called with the output screen object to be connected as a parameter. Here, the 'setDisplayScreen' method can be understood as a method performing the function of connecting the logical screen and the output screen, and can be provided by the MultiScreenContext module 1230.

For example, the 'setDisplayScreen' method can be expressed in the form of 'public void setDisplayScreen (HScreen screen) throws SecurityException, IllegalStateException', which associates the parameter 'HScreen' instance with the current logical screen . In this case, the 'HScreen' instance is preferably an output screen.

If the 'setDisplayScreen (HScreen screen)' method is executed without exception handling in this case, the current logical screen is no longer displayed It is not associated with the output screen.

And as an exception handling for the 'setDisplayScreen (HScreen screen)' method, a 'SecurityException' exception and an 'IllegalStateException' exception can be thrown.

An 'IllegalStateException' exception is one in which the current screen is not a logical screen, or an output screen provided as a parameter to the nature of the hardware or software platform is associated with a particular logical screen to associate the current logical screen with the output screen corresponding to that parameter Can be carried out in the absence.

When a service, a logical screen, and a plurality of logical screens and one output screen are connected, an area of an output screen where each logical screen is to be displayed is set (S1340). At this time, for each logical screen, the method provided by the MultiScreenContext module 1230 may be called to set the area to be displayed on the output screen.

Figure 15 is an illustration of the operation of an output module 960 in accordance with an embodiment of the present invention in which the output module 960 can perform an output port search 1510 or an output port change 1520, have.

To perform an output port search 1510, the output module 960 may call the method 'getOutputPorts'. The 'getOutputPorts' method extracts the video output port to which the screen is mapped. Its data type is the 'VideoOutputPort []' class type in the 'org.ocap.hardware' package. That is, the 'getOutputPorts' method returns a set of 'VideoOutputPort' instances connected to 'HScreen'.

The 'getOutputPorts' method returns at least one instance of 'VideoOutputPort' when the screen type is an output screen and is connected to the video output port. When the type of the screen is logical screen, If connected, the 'getOutputPorts' method returns the 'VideoOutputPort' instance connected to the output screen. Also, if the type of the screen is a logical screen and the logical screen is not connected to the output screen, the 'getOutputPorts' method may return NULL.

16A is an example of a code for retrieving an output port connected to a screen, which indicates that a 'getOutputPorts' method is applied to 'screen' which is a screen object of the 'MultiScreenContext' module.

To perform an output port change 1520, the output port 960 may call the 'addOutputPort' method or the 'removeOutputPort' method. The 'addOutputPorts' method adds a 'VideoOutputPort' instance to the set of video output ports to which the screen is mapped and includes 'VideoOutputPort' as its parameter.

The 'addOutputPort' method can be expressed in the form of 'void addOutputPort (org.ocap.hardware.VideoOutputPort port) throws java.lang.SecurityException, java.lang.IllegalStateException'.

In the exception handling performed by the 'addOutputPort' method, a 'java.lang.SecurityException' exception may be thrown if the given permission is not given, and if the screen is not an output screen, (Eg if the platform is permanently connected to a specific set of instances of 'VideoOutputPort'), or a 'VideoOutputPort' instance assigned to that screen, if the 'VideoOutputPort' instance for that screen can not be changed The 'java.lang.IllegalStateException' exception can be thrown if it is already connected.

The 'removeOutputPort' method removes the 'VideoOutputPort' instance from the set of video output ports to which the screen is mapped and includes 'VideoOutputPort' as its parameter.

The 'removeOutputPort' method can be expressed in the form of 'void removeOutputPort (org.ocap.hardware.VideoOutputPort port) throws java.lang.SecurityException, java.lang.IllegalStateException, java.lang.IllegalArgumentException'.

In exception handling by the 'removeOutputPort' method, a 'java.lang.SecurityException' exception may be thrown if no privileges are given, and if the screen is not an output screen, the 'VideoOutputPort' A 'java.lang.IllegalStateException' exception may be thrown if the instance can not be changed (for example, if the platform is permanently attached to the specified set of instances of 'VideoOutputPort'). In addition, a 'java.lang.IllegalArgumentException' exception may be thrown if the specified 'VideoOutputPort' instance is not connected to the screen.

16B is an example of a code for changing an output port connected to a screen, which indicates that the 'addOutputPort' method is applied to 'screen' which is a screen object of the 'MultiScreenConfigurableContext' module.

FIG. 17 is a flowchart illustrating a process of exchanging services represented on a logical screen by the respective modules shown in FIG.

First, the MultiScreenManager module 1210 suspends the services that exist in the two logical screens to be exchanged with each other (S1410).

Then, the information of the service connected to the two logical screens is exchanged (S1420). At this time, the service context set in the logical screen can be exchanged by calling the 'removeServiceContext' method and the 'addServiceContext' method for each of the two logical screen objects. The 'removeServiceContext' method can be understood as a method to remove the service context connected to the logical screen. The 'addServiceContext' method is a method to add a new service context to the logical screen. And the 'removeServiceContext' method and the 'addServiceContext' method may be provided by the MultiScreenContext module 1230. That is, in the present invention, not only the effect of exchanging information between the main screen and the sub screen in the related art by exchanging information about the service connected to the logical screen, but also, for example, even if three or more services are performed on the display screen, Services can be exchanged between screens.

When the information of the service connected to the two logical screens is exchanged, an event is generated (S1430) that the connection between the service and the logical screen is changed (S1430), and the 'MultiScreenContextEvent' module 1240 transmits the generated event to the 'MultiScreenContextListener' module 1250 And the execution of the service newly connected to the two logical screens is resumed (S1440).

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

According to the apparatus for providing multiple screens of the present invention and the method for dynamic configuration of multiple screens as described above, in order to dynamically configure a plurality of screens providing a plurality of contents on a physical display screen, By connecting to a number of output ports, there is an advantage in allowing the user to operate the generated screens to suit their purposes.

Claims (31)

A service processing module for generating a screen for expressing the received service; And And an output module for retrieving an output port associated with the screen, Wherein the screen comprises at least one of a logical screen on which an application included in the service is executed and an output screen on which the logical screen is mapped. delete The method according to claim 1, Wherein the output screen comprises a screen on which the application is executed. The method according to claim 1, Wherein the screen provides a multiple screen including a Picture-in-Picture (PiP) screen. The method according to claim 1, Wherein the screen provides a multiple screen including a Picture-Out of Picture (PoP) screen. The method according to claim 1, Wherein the output module provides at least one output port for the screen to provide multiple screens for mapping to the screen. A service processing module for generating a screen for expressing the received service; And And an output module for changing a connection relationship between an output port connected to the screen and the screen, Wherein the screen comprises at least one of a logical screen on which an application included in the service is executed and an output screen on which the logical screen is mapped. delete 8. The method of claim 7, Wherein the output screen comprises a screen on which the application is executed. 8. The method of claim 7, Wherein the screen provides a multiple screen including a Picture-in-Picture (PiP) screen. 8. The method of claim 7, Wherein the screen provides a multiple screen including a Picture-Out of Picture (PoP) screen. 8. The method of claim 7, Wherein the output module provides at least one output port for the screen to provide multiple screens for mapping to the screen. Creating a screen for presenting the received service; And Retrieving an output port associated with the screen, Wherein the screen comprises at least one of a logical screen on which an application included in the service is executed and an output screen on which the logical screen is mapped. delete 14. The method of claim 13, Wherein the output screen comprises a screen on which the application is executed. 14. The method of claim 13, Wherein the screen comprises a picture-in-picture (PiP) screen. 14. The method of claim 13, Wherein the screen comprises a Picture-Out of Picture (PoP) screen. 14. The method of claim 13, Creating at least one output port for the screen; And And mapping the generated output port to the screen. Creating a screen for presenting the received service; And Changing a connection relationship between an output port connected to the screen and the screen, Wherein the screen comprises at least one of a logical screen on which an application included in the service is executed and an output screen on which the logical screen is mapped. delete 20. The method of claim 19, Wherein the output screen comprises a screen on which the application is executed. 20. The method of claim 19, Wherein the screen comprises a picture-in-picture (PiP) screen. 20. The method of claim 19, Wherein the screen comprises a Picture-Out of Picture (PoP) screen. 20. The method of claim 19, Creating at least one output port for the screen; And And mapping the generated output port to the screen. An apparatus for receiving at least one service from among a video service, an audio service, and a data service and providing a screen for displaying the received service, A module for setting screen property information of the screen including an association between the screen and the output port and confirming the state of the screen property information; And And a module for identifying an output port currently associated with the screen. 26. The system of claim 25, wherein the output port validation module comprises: To identify a currently associated output port based on output port information associated with the screen among screen property information of the screen. 26. The method of claim 25, Wherein the screen attribute information further includes at least one of display method information of the screen and association information of the screen, the arrangement method of the screen, and the service. 26. The screen supply apparatus according to claim 25, Further comprising: a module for managing the setting operation of the screen attribute information so that the received service is displayed on the screen, and managing a reproduction environment of the service. 26. The method of claim 25, Wherein the screen is at least one or more than one. 26. The method of claim 25, Wherein the output port is at least one or more than one. 26. The method of claim 25, Wherein the screen comprises at least one of a logical screen and an output screen, Wherein the output screen is a screen output to an output port, and wherein the logical screen is a screen to which the service is associated.

Images