JP2009504070A - Apparatus for providing a multi-screen and a method for dynamically configuring the multi-screen - Google Patents

Abstract

The present invention relates to an apparatus for providing a multi-screen and a method for dynamically configuring the multi-screen, and the apparatus for providing the multi-screen receives video information, audio information, or data information and restores related services. A digital signal processing module, a service processing module that generates an output screen, a logical screen, and an overlay screen that represent the restored service, and a plurality of generated logical screens are arranged in different positions in the output screen and generated And an output module for arranging the overlay screen to be overlaid on the output screen.

Description

  The apparatus and method according to the present invention relates to a multi-screen configuration, and more particularly, to a dynamic configuration of a plurality of screens for providing a plurality of contents on a physical display screen and a device for providing the plurality of screens.

  In a conventional broadcast receiving apparatus such as a digital TV or a digital set-top box, only one content is displayed on one physical display screen, or two screens of a main screen and a sub screen are displayed on one physical display screen. Are generally shown simultaneously.

  At this time, even if the main screen and the sub-screen are shown at the same time, the two screens can be arranged only by some methods already determined by the broadcast receiving apparatus. All elements (video, audio, data, or a combination of these) that make up the content are played back only for the content shown on the main screen, and only some of the elements that make up the content are played back in a limited way through the sub-screen. Is done.

  In addition to broadcasting services such as satellite broadcasting, terrestrial broadcasting, and cable broadcasting, sources that provide content include recording media such as DVDs or external devices connected to external input terminals. In addition, how the contents provided by various sources are displayed on the display screen is also limited and fixed.

  On the other hand, in an application environment for an interactive TV such as MHP (Multimedia Home Platform), ACAP (Advanced Common Application Platform), and OCAP (Open Cable Application Platform), a screen that is generally output through a physical display screen is one screen. Assume that

  For example, in the application environment for interactive TV, the structure of the user interface (User Interface; UI) based on the HAVi (Home Audio / Video Interoperability) standard is adopted, but the number of screens is not limited by the HAVi UI standard. In use, it is common to assume that there is a single screen output through the display screen.

  In such an environment, a plurality of contents are shown through a plurality of independent screens, and at the same time, the contents represented on each screen are subjected to decoding, digital signal processing, user interaction processing, etc. Difficult to control application lifecycle and resource usage on each screen.

  Accordingly, there is a need for a method that can provide various contents on a display screen in various ways.

  The present invention provides an apparatus and method for dynamically configuring a plurality of screens that provide a plurality of contents on a physical display screen.

  Another object of the present invention is to provide an overlay screen located on the outermost side of the output screen.

  To achieve the above object, an apparatus for providing a multi-screen according to an embodiment of the present invention includes a digital signal processing module that receives video information, audio information, or data information and restores related services, and the restored A service processing module for generating a plurality of output screens representing a service, a logical screen and an overlay screen, and mapping the generated plurality of logical screens in different positions in the output screen, thereby generating the generated overlay screen And an output module for overlaying on the output screen.

  To achieve the object, an apparatus for providing multiple screens according to an embodiment of the present invention generates an output screen, a logical screen, and an overlay screen on which a service is represented, and associates the logical screen and the overlay screen with the service. And a service processing module for mapping the generated logical screen to a predetermined area in the generated output screen, and an output module for overlaying the generated overlay screen on the generated output screen.

  In order to achieve the above object, an apparatus for providing a multi-screen according to an embodiment of the present invention includes a digital signal processing module that receives video information, audio information, or data information to restore a service, and the restored An output screen representing a service, a service processing module for generating a logical screen and an overlay screen, and mapping the generated logical screen to a predetermined area in the output screen, and overlaying the generated overlay screen on the output screen An output module.

  To achieve the above object, a method for dynamically configuring multiple screens according to an embodiment of the present invention includes receiving a video information, audio information, or data information to restore a service; and Generating an output screen for rendering, a plurality of logical screens and an overlay screen, mapping the generated plurality of logical screens in different positions in the output screen, and the generated overlay screen Overlaying on the output screen.

  In order to achieve the above object, a method for dynamically configuring multiple screens according to an embodiment of the present invention includes generating an output screen, a logical screen and an overlay screen on which a service is represented, and the generated screen. Mapping the generated logical screen to a predetermined area in the output screen and overlaying the overlay screen on the output screen.

  Advantages and features of the present invention and methods of achieving them will be apparent with reference to the embodiments described in detail below in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and can be embodied in various different forms. However, the present embodiments completely disclose the present invention and provide those skilled in the art with the scope of the present invention. It is provided for completeness of the description and the present invention is only defined by the scope of the claims.

  Hereinafter, the present invention will be described with reference to a block diagram or a processing flowchart for explaining a device for providing a multi-screen according to an embodiment of the present invention and a method for dynamically configuring the multi-screen. At this time, it can be understood that each block in the process flowchart drawing and the combination of the flowcharts are performed by computer program instructions. These computer program instructions may be installed on a general purpose computer, special purpose computer or other programmable data processing equipped processor so that the instructions performed through the computer or other programmable data processing equipped processor are shown in the flowchart. A means for performing the function described in the block is generated. These computer program instructions can also be stored in a computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement the function in a particular manner. Instructions that are available or stored in computer readable memory may also produce manufactured items with instruction means that perform the functions described in the blocks of the flowchart. The computer program instructions can also be mounted on a computer or other programmable data processing equipment, so that a series of operational steps are performed on the computer or other programmable data processing equipment. Instructions for generating a process to be performed and performing a computer or other programmable data processing equipment may also provide steps for performing the functions described in the blocks of the flowchart.

  Each block may also represent a module, segment, or portion of code that includes one or more executable instructions for performing a specified logical function. It should also be noted that in some alternative implementations, the functions mentioned in the block can occur out of order. For example, two blocks shown in succession may be performed substantially simultaneously, or the blocks may be performed in reverse order depending on the function to which they are sometimes applied.

  On the other hand, in order to facilitate the explanation of the present invention, a basic concept related to the present invention is defined.

  'Service' is multimedia content expressed as a single unit, and a plurality of service components form one service.

  The “service component” is a part constituting a service, and includes a video component, an audio component, a data component, and the like. At this time, the data component indicates an application program existing in the service.

  Here, the application can be classified into an unbound application and a service bound application. However, since the unbound application is not associated with a specific channel, the execution of the application is not affected by the channel change. Moreover, since it generally has a high priority, resources for execution are smoothly allocated. The monitor application corresponds to a special unbound application that can have the highest priority.

  On the other hand, a service bound application is related to a transmission stream, and generally has a lower priority than an unbound application. Service bound applications do not perform critical system functions and are more likely to give up resource allocation than unbound applications when competition for resources occurs. Service bound applications include a linkage type that operates in conjunction with a stream that is currently being transmitted, and a non-linkage type that operates regardless of the stream that is being transmitted.

  The “service context” includes various resources, devices, execution state information, and the like related to the execution of the service, and represents an object that can control the execution of the service.

  The 'display screen' means a physical device in which the service content is actually expressed, an external output port from which the service content is output, or a storage device in which the service is stored.

  An 'output screen' is a screen that is actually output on the display screen, and any service is set directly on the output screen and expressed through the display screen, or at least one mapped to a certain area of the output screen The above logical screen is output through the display screen.

  The 'logical screen' is a space in which an arbitrary service is expressed, and exists only virtually in the memory before being mapped to the output screen, and is not actually displayed on the display screen.

  In addition, the logical screen and the output screen can be composed of a combination of a background still image, a video raster, and a graphic raster, where a graphic raster is a combination of text, lines, colors, and images. , Video frames can be mixed and provided.

  The 'overlay screen' is a space for outputting subtitles and other functions of the device (for example, volume display and mute display). Here, the overlay screen is overlaid on the output screen (ie, located on the outermost side of the output screen).

  A plurality of overlay screens are output on the output screen, and the output overlay screens are overlaid at predetermined positions.

  The overlay screen outputs a data component among services transmitted from terrestrial broadcasting, cable broadcasting, PVR (personal video recorder), and the like.

  For example, the overlay screen stores the transmitted data component on a recording medium and then maps it to the output screen.

  In addition, the overlay screen is overlaid on the output screen based on the 'z-Order' attribute that determines the order on the z-axis expressed on the output screen or the identification information of the overlay screen. Here, the identification information of the overlay screen refers to information notifying that it is an overlay screen.

  For example, if the overlay screen is mapped to the output screen based on the 'z-Order' attribute, the overlay screen's z-Order attribute value has a larger attribute value than the logical screen that can be mapped to the output screen. In addition, when the overlay screen is positioned on the output screen based on the identification information of the overlay screen, the screen having the identification information of the overlay screen is overlaid in front of the unconditional output screen (that is, the outermost side). Is set.

  It is also possible that there are one or more overlay screens. In such a case, the z-axis order between the overlay screens is determined based on the z-order attribute value of the overlay screen.

  In addition, since the unbound application is generally easily expressed on the entire output screen regardless of the current configuration of the output screen, the overlay screen is more suitable for use in expressing the unbound application than the service bound application.

  For example, an EPG (Electric Program Guide) application, which is a typical unbound application, has an entire area on the top side of the z-axis regardless of the number of logical screens and any arrangement on the current display screen. Shown as is most convenient to the user.

  'Main service' means a service selected by the user through a menu or remote control shown on the display screen, or an application selected as a main service through an API (Application Program Interface). Called 'screen'.

  'PiP (Picture-in-Picture) service' means a service selected by a user through a menu appearing on a display screen or a remote control, or an application selected as a secondary service in a main screen through an API. It can be represented through a 'PiP screen' or main screen.

  A “PiP screen” includes a screen that occupies a part of another screen as shown in FIGS. 1A to 1D, and another screen without overlapping with another screen as shown in FIGS. 1E and 1F. And a screen that is displayed at the same time.

  FIG. 2 is an exemplary diagram illustrating a relationship between a logical screen, an overlay screen, and an output screen according to an embodiment of the present invention. Referring to FIG. 2, a service is represented through logical screens 210, 212, 214 and an overlay screen 216, and such a logical screen is mapped to the output screens 220, 222, 224 by a predetermined mapping block 230. The overlay screen 216 is overlaid on the entire area of the output screens 220, 222, and 224 separately from the mapping block 230. Here, the overlay screen 216 is overlaid on an output screen to which a plurality of logical screens are mapped. A plurality of overlay screens may be overlaid on the output screen.

  At this time, the output screen referred to by 220 is expressed by mapping and overlaying the logical screen referenced by 210 and 212 and the overlay screen referenced by 216, and the output screen referenced by 222 is The logical screen referenced by 212 and 214 and the overlay screen referenced by 216 are mapped and overlaid, and the output screen referenced by 224 is the logical screen referenced by 210, 212 and 214. , And 216, the overlay screen is mapped and overlaid.

  In this way, at least one or more logical screens on which the service is represented are mapped to any area of the output screen by the mapping block 230, and the overlay screen is overlaid on any area of the output screen separately from the mapping block 230. Can be located.

  Meanwhile, the mapping block 230 may be understood as a collection of various information for mapping the logical screen and the output screen. Examples of such information include coordinate information of the area where the logical screen is mapped to the output screen, identification information for distinguishing the logical screen and the output screen, information about the order in which multiple logical screens are represented on the output screen, and the like. Can be included.

  The mapping block 230 can resize the logical screen and assign it to a certain area of the output screen. That is, the mapping block 230 can perform a scaling function and a position assignment function for a logical screen, and FIGS. 3A to 3E show a configuration of such a mapping block, that is, a screen including a mapper.

  Referring to FIG. 3A, the main screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to the entire output screen while maintaining the size as it is by the mapper. The PiP screen having only the video component is mapped to a certain area of the output screen while its size is reduced by the mapper. At this time, the mapped PiP screen is located on the main screen, which is determined by the Z value. Z represents a z-order value, and z-order will be described later. Also, an overlay screen can be combined with the output screen, but the overlay screen is a special screen placed on the outermost side, and can be used when subtitles need to be provided, for example. The PiP screen may have only a video component as shown in FIG. 3A, but may be formed by a combination of a background still image B, a video raster V, and a graphic raster G as shown in FIG. 3B.

  Referring to FIG. 3C, the main screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to the entire output screen while maintaining the size as it is by the mapper. Then, the two PiP screens # 1 and # 2 having only the video component are mapped to a certain area of the output screen while the size thereof is reduced by the mapper. At this time, the mapped PiP screen is located on the main screen, and the Z value can be kept the same at this time. An overlay screen can be combined with the output screen. The screen configuration may include a plurality of PiP screens having only video components as shown in FIG. 3C, but a combination of background still image B, video raster V, and graphic raster G as shown in FIG. 3D. A plurality of PiP screens may be formed.

  FIG. 3E shows a POP (Picture-outside-picture) screen, but if the conventional PiP clean is a screen that is represented inside the main screen, the POP screen is represented outside the main screen. It can be understood as a screen. Referring to FIG. 3E, a plurality of POP screens # 1 and # 2 formed by a combination of the background still image B, the video raster V, and the graphic raster G are reduced in size by the mapper, while the output screen Is mapped to a certain area. At this time, the Z values of the mapped POP screens # 1 and # 2 can be kept the same. An overlay screen can be combined with the output screen and expressed.

  The mapping block 230 may be implemented by an interface, a function, or the like created and performed in various computer program languages, and may generate or change a relationship between the logical screen and the output screen using the information as a parameter. .

  The mapping block 230 may be implemented in hardware so as to perform a mapping function between the logical screen and the output screen.

  Services provided from various sources are represented on the output screen and can be output through the display screen. Hereinafter, this will be described in detail with reference to FIG.

  4A to 4C are exemplary diagrams illustrating a method of independently overlaying various graphic contents on an output screen according to an embodiment of the present invention (ie, a method in which a plurality of overlay screens are overlaid on the output screen). is there. Here, the graphic content belonging to the service must be directly connected to the graphic plane belonging to the respective overlay screen.

  Referring to FIG. 4A, the main screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to the entire output screen while maintaining the size as it is by the mapper. The PiP screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to a certain area of the output screen while its size is reduced by the mapper. At this time, the mapped PiP screen is located on the main screen, which is determined by the Z value. Z represents a z-order value. An overlay screen having only graphic components is overlaid on the output screen. At this time, the Z value of the overlay screen has the largest value, so that the overlay screen is overlaid on the outermost side of the output screen. Here, the mapper is not used for the overlay screen.

  Referring to FIG. 4B, the main screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to the entire output screen while maintaining the size as it is by the mapper. The PiP screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to a certain area of the output screen while the size is reduced by the mapper. Two overlay screens # 1 and # 2 having only graphic components are overlaid on the output screen. At this time, the Z values of the overlay screen may be maintained different from each other or may be maintained the same.

  Referring to FIG. 4C, the main screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to the entire output screen while maintaining the size as it is by the mapper. The PiP screen formed by the combination of the background still image B, the video raster V, and the graphic raster G is mapped to a certain area of the output screen while the size is reduced by the mapper. A plurality of overlay screens # 1 and #N having only graphic components are overlaid on the output screen. At this time, the Z values of the overlay screen may be maintained different from each other or may be maintained the same.

  5A to 5C are views illustrating a method of using a plurality of graphic planes in one overlay screen according to an embodiment of the present invention. Here, by associating a service context with one overlay screen, it is possible to represent each graphic content of the service associated with the overlay screen.

  FIG. 5A relates to a single plane overlay screen, where a single graphic plane is used for subtitles only or other functions of subtitles and equipment (eg, volume display, mute display, equipment setup user interface). Used for sharing between. Here, each function in a shared usage scenario must potentially redraw the entire content every time some function changes its representation. Such re-illustration will only decrease after updating a subset of visual pixels (eg, within a modified region).

  However, in addition to potential re-illustration, such an optimization scheme increases coding complexity, debugging, and at the same time consumes higher computation and memory cycles. On the other hand, such settings require minimal hardware resources. For example, it does not require a hardware compositor or multiple graphics plane.

  FIG. 5B relates to a dual plane overlay screen, where the compositor and the second graphic plane are separated from the user interface for subtitles and other functions shared by the second graphic plane (Gs). Added for. In addition, the shared graphic plane is shared in an application environment including a native environment that implements a device setting function. However, it is desirable that an unbound application be utilized to render the overlay screen independent of the current service bound application graphic, as well as independent of the PiP and POP settings.

  When a multi-environment is actively represented in the shared plane, sharing is done by a mutual exclusion basis or by requesting re-illustration in the shared plane during that time.

  Ultimately, previous overlay screen settings can be further generalized by providing subtitles and distinct graphic planes for each application environment.

  FIG. 5C relates to an N-plane overlay, and the generalization provides the simplest system architecture while requiring the most basic resources, ie, a dedicated graphic plane for each application environment.

  The shape and resolution of the overlay screen remains constant and is expected to match well with the overall display shape.

  Dedicated graphic planes with overlay screens in the OCAP structure are ideally used by unbound applications, unlike service bound applications. This is not only independent of the PiP and POP settings, but also allows the use of a constant resolution, full display graphic independent of the current service bound application graphic.

  For example, such use not only provides a user visual display that allows screen applications to focus for unlimited input event dispatch, but also allows unrestricted applications to draw outlines, PiP and POP It provides a title for the screen.

  FIG. 6 is a diagram illustrating an application example of an overlay screen according to an embodiment of the present invention. Referring to FIG. 6A, as another embodiment of the overlay screen, the screen having the current focus among various screens shown in the output screen can be used to display one. Here, the screen having the focus means a screen including an application that receives an event when the user transmits an input event through an interface such as a remote controller.

  Referring to FIG. 6B, the overlay screen can also be used to display the boundaries of each screen shown in the output screen, or to display the title of the service represented on each screen.

  FIG. 7 is an exemplary diagram illustrating an example of a source providing a service according to an embodiment of the present invention.

  In general, there are sources providing services such as terrestrial broadcasting 320 and cable broadcasting 330, and services stored in a predetermined recording medium such as PVR (personal video recorder) 340 are provided. There are also sources to provide. Further, although not shown in FIG. 7, a source that provides a service through a wired or wireless network may be included.

  At this time, the broadcast receiving apparatus 310 receives services from such a source, and generates a logical screen representing each service.

  Then, according to a predetermined scheme, a scheme set by the user or application, any service is set directly on the output screen and expressed through the display screen, or at least one or more mapped to a certain area of the output screen A logical screen and an overlay screen are output through the display screen 350.

In FIG. 7, terrestrial broadcasting 320, cable broadcasting 330, and PVR are examples of sources that provide services.
Although 340 is illustrated, the source for providing the service is not limited to this, and may be included in the source of the present invention as long as it provides multimedia content expressed as one unit.

  On the other hand, services in the present invention include abstract services and non-abstract services, which are illustrated in FIGS. 8A and 8B, respectively.

  An abstract service is not a service that is transmitted in real time from a broadcast signal, but is an independent service for a broadcast channel, and is formed of only a data component, that is, an application program, without a video component and an audio component among service components. Service is an abstract service. For example, a service formed by an unbound application in the OCAP (Open Cable Application Platform) standard belongs to this service.

  A non-abstract service can be understood as the rest of the service excluding the abstract service.

  In the present invention, independence can be given to each of the abstract service and the non-abstract service. For example, an abstract service may be set directly on an output screen without going through a logical screen, and a non-abstract service may be mapped to an output screen that is represented on the logical screen and set with an abstract service. Then, the output screen can be output through a display screen, whereby an abstract service and a non-abstract service can be independently expressed on one output screen. Further, after both abstract service and non-abstract service are mapped to separate logical screens, each logical screen may be mapped to one output screen. That is, the abstract service and the non-abstract service can be expressed on the output screen as independent forms.

  On the other hand, the logical screen, the overlay screen, and the output screen in the present invention may be defined as separate objects, but 'screen' functions as a logical screen according to attribute information of one object called 'screen'. Function as an overlay screen or function as an output screen.

  That is, among the attribute information related to the screen object, it can be seen from the type information whether the screen is a logical screen, an overlay screen, or an output screen.

  As such screen object attribute information, there are 'Type', 'z-Order', 'Display_Area', 'Visibility', 'Associated_Display_Screen', 'Associated_Service_Contexts', and 'Output' information.

  9A and 9B show screen object attribute information and types of interfaces for processing such attribute information.

  The 'Type' attribute 510 is attribute information indicating whether the screen is a logical screen or an output screen.

  The 'z-Order' attribute 520 is for determining the order on the z-axis when the logical screen and the overlay screen are represented on the output screen. The overlay screen may not have the 'z-Order' attribute 520. Here, FIG. 10 illustrates how the logical screen and the overlay screen are indicated by the z-order attribute on the output screen.

  In FIG. 10, a first logical screen 620 and a second logical screen 630 are mapped onto a certain area on the output screen 610, and an overlay screen 640 is overlaid on the output screen 610. Yes. At this time, the first logical screen 620 is represented on the output screen, the second logical screen 630 is represented thereon, and the overlay screen 640 is represented thereon. That is, the output screen 610, the first logical screen 620, the second logical screen 630, and the overlay screen 640 are expressed in the z-axis direction. In such a case, the z-order of the first logical screen 620 is displayed. The attribute value may be set to 1, the z-order attribute value of the second logical screen 620 may be set to 2, and the z-order attribute value of the overlay screen 640 may be set to 3. At this time, the z-order attribute value may be in any number or character form as long as it is information indicating the order in which the logical screen is expressed on the z-axis of the output screen.

  The 'Display_Area' attribute 530 means information about the area of the output screen that is output by mapping the logical screen to the output screen, which is exemplified in FIGS. 11A and 11B.

  FIG. 11A shows that the logical screen 710 is mapped to the entire area of the output screen 720 and output, and FIG. 11B shows that the logical screen 730 is mapped to a partial area of the output screen 740 and output. Is shown.

  At this time, the information indicating the “Display_Area” attribute is two-dimensional coordinate information on the output screen, or can be expressed by a specific position on the output screen and an offset value from the specific position.

  The 'Visibility' attribute 540 is an attribute that determines whether a logical screen is displayed on the output screen, and changing this attribute value indicates or disappears the logical screen on the physical display screen. Can do.

  The 'Associated_Display_Screen' attribute 550 represents identification information of an output screen connected to the corresponding logical screen. Logical screens that are not connected to an output screen are not shown on the display screen or sent to other external outputs.

  The 'Associated_Service_Contexts' attribute 560 represents information about the service context connected to the logical screen or the output screen itself, but the service set in the service context is represented on the logical screen or the output screen.

  The 'OutputPort' attribute 570 represents information about a target on which the output screen is output, and can include a display screen, a wired / wireless communication medium, various recording media, and the like as targets on which the output screen is output.

  The 'Overlay-Information' attribute 580 indicates identification information of the overlay screen that informs that it is an overlay screen, and position information that allows the overlay screen to be overlaid on a predetermined area of the output screen. Here, the overlay screen can be positioned at the forefront on the output screen through the 'Overlay-Information' attribute.

  On the other hand, an interface for checking or changing the value of the attribute information shown in FIGS. 9A and 9B can be provided. Here, as shown in FIGS. 9A and 9B, the value of the attribute information is set. 'Set' interface to link the logical screen with the output screen, add attribute information value, or 'add' interface to link the logical screen with service, to check the attribute information value There are a 'get' interface and a 'remove' interface for deleting attribute information values. Such an interface can be understood as a process, a function, a procedure, a method, or the like that performs each function.

  For example, a 'getDisplayScreen (void)' method performs a function of returning an output screen associated with the current screen. For example, if the current screen is a logical screen, the associated output screen is returned; if the current screen is an output screen, reference information about the current screen is returned, although the current screen is a logical screen, If the output screen does not exist, 'NULL' is returned.

  As yet another example, the 'public void setDisplayArea (HS Screen Rectangle rect), Throws SecurityException, IllegalStateException' method provides the ability to map the current logical screen to a predetermined area of the associated output screen. The instance provided as a parameter is' org. havi. The ui package is an 'HSScreen Rectangle' class type and has two-dimensional position information. Then, as exception processing for the ‘setOutputScreen (HSScreenscreen)’ method, a ‘SecurityException’ exception and an ‘IllegalStateException’ exception can be performed. The 'IllegalStateException' exception is raised when the current screen is not a logical screen, or because of hardware or software platform characteristics, the area of the output screen associated with the current logical screen is not changed.

  As yet another example, the 'getOutputArea (void)' method returns information about the current screen area to the form of the 'HSScreenRectangle' class. If the current screen is an output screen, it returns 'HScreenRectangle' information with the same value as 'HSScreenRectangle (0,0,1,1)', and if the current screen is a logical screen , Information about the area occupied by the logical screen in the associated output screen is returned. If the current screen is a logical screen but there is no associated output screen, the 'NULL' value is returned.

  Each interface name described above is merely a name for representing each function, and is not limited to the name, but should be understood as the function.

  FIG. 12 is an exemplary diagram illustrating a process in which three services are set on three logical screens, mapped to one output screen, and output. Referring to FIG. 12, the first service is a service in which all of the three types of service components of video / audio / data exist, and the second service is a service in which only the video component and the audio component exist. The 3 service is an example in which only the data component exists. Of course, in the present invention, there are no restrictions on service components, and FIG. 12 shows one possible example.

  As can be seen from FIG. 12, the first service, the second service, and the third service are shown on the display screen in a form similar to the conventional method, but according to the present invention, the logical screen is mapped and the overlay screen is separated. Multiple services can be independently expressed at various positions on the display screen without any limitation without mapping.

  FIG. 13 is a block diagram illustrating a configuration of an apparatus for providing a multi-screen according to an embodiment of the present invention.

  Referring to FIG. 13, the multi-screen providing apparatus 900 according to the present invention includes a digital signal processing module 940, a service processing module 950, an output module 960, and a user / application interface module 965.

  At this time, the broadcast signal receiving module 910, the recording medium 920, or the external input module 930 can be provided as a source for providing the service, and the display screen 970, the recording medium 980, or the external output module 990 as the medium from which the service is output. Can be provided.

  At this time, the term 'module' used in the present embodiment means software or a hardware component such as FPGA or ASIC, and the module plays a predetermined role. However, the module is not meant to be limited to software or hardware. The module may be configured to reside on an addressable recording medium and may be configured to play back one or more processors. Thus, by way of example, modules include components such as software components, object-oriented software components, class components and task components, processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, Includes microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided in the components and modules can be combined into fewer components and modules or further separated into additional components and modules. In addition, the components and modules may be implemented to play one or more CPUs in a device or secure multimedia card.

  The digital signal processing module 940 receives various configuration information, such as video information, audio information, or data information, that constitutes a service such as multimedia content from the broadcast signal receiving module 910, the recording medium 920, or the external input module 930. Receive.

  At this time, the broadcast signal receiving module 910 is a module that receives and transmits satellite, terrestrial, or cable broadcast signals, and the recording medium 920 stores video information, audio information, data information, or the like constituting the service. The external input module 930 may be understood as a module that receives and transmits video information, audio information, data information, or the like constituting a service from other devices connected to the network, such as a network interface module.

  The digital signal processing module 940 restores a service using the received service component. At this time, a plurality of services can be restored. At this time, the restored service includes an abstract service or a non-abstract service.

  Here, “a plurality of services” may mean two or more services transmitted from the broadcast signal receiving module 910, for example, and two services transmitted from the broadcast signal receiving module 910 and the recording medium 920, respectively. It may mean the above services.

  Services restored in digital signal processing module 940 may be restored by user or application selection through user / application interface module 965. At this time, the user or the application can select which service is connected to which screen.

  The service processing module 950 generates a plurality of logical screens, output screens, and overlay screens for representing the service restored by the digital signal processing module 940.

  The output module 960 maps the logical screen generated by the service processing module 950 to a predetermined area on the output screen, and overlays the overlay screen on the predetermined area on the output screen. At this time, the operation of mapping the logical screen to the output screen and the operation of overlaying the overlay screen on the output screen may be already set or set by the user or the application through the user / application interface module 965.

  Also, the service restored by the digital signal processing module 940 may be directly connected to the output screen and output from the output module 960 without being connected to the logical screen in the service processing module 950.

  The output screen by the output module 960 may be output through a physical display screen 970 or recorded on a recording medium 980. Here, the recording medium 980 can be read by a computer, and includes a floppy (registered trademark) disk, a hard disk, a CD-ROM, a DVD, a DVD-ROM, a BD (Blu-ray Disc), and a semiconductor memory.

  Further, it may be transmitted to other devices connected to the network through the external output module 990.

  To this end, the output module 960 can comprise multiple output ports to which an output screen is provided, but in such a case, it is specified through the already configured basic output port or user / application interface module 965. An output screen can be provided through the output port.

  A user or application can select or restore a desired service through the user / application interface module 965. In addition, the user or application may select an arbitrary output screen among the plurality of output screens through the user / application interface module 965.

  Each module shown in FIG. 13 is illustrated as being separated according to its function, so that it can be combined with another module in actual implementation.

  FIG. 14 is a flowchart illustrating a method for dynamically configuring multiple screens according to an embodiment of the present invention.

  In general, video information, audio information, data information, and the like constituting multimedia content are transmitted in a predetermined format such as an MPEG stream. Accordingly, a device that performs a service such as multimedia content receives the information as described above and restores the corresponding service (S1010). At this time, the service to be restored may be selected or preset by the user or application. The user can select which service is linked to which screen by using a menu or a remote control shown on the display screen, or an application using the API.

  On the other hand, the data information includes application information regarding application programs existing in the service, and such application information includes signal information indicating whether the application program can be performed on the PiP screen. Examples of application information include AIT (Application Information Table) based on the MHP standard and XAIT (eXtended Application Information Table) based on the OCAP standard. The signal information can be added to such application information.

  Next, the restored service is set to be represented by the logical screen according to the present invention (S1020), and the logical screen is mapped and overlaid on the output screen according to the present invention (S1030). The output screen is provided through the network (S1040).

  On the other hand, FIG. 14 shows that the restored service is provided through the output screen through the logical screen, but may be provided through the output screen directly without going through the logical screen.

  In addition, when the user or application selects the PiP service, the PiP service can be expressed as two modes. However, in the first mode, a separate logical screen for the PiP service, for example, a PiP screen is not generated. Only the video component of the PiP service selected on the main screen is represented, and in the second mode, a separate logical screen for the PiP service is generated, and the selected PiP service is represented in the generated PiP screen. The

  On the other hand, FIG. 14 illustrates a process in which one service is mapped and overlaid on an output screen for convenience of explanation, but a plurality of services can be transmitted through a plurality of logical screens or overlay screens using screen attribute information. , Or directly, can be mapped or overlaid to any region within one output screen.

  Thus, if the output screen is provided through a display screen, the user or application can perform multiple services.

  FIG. 15 is an exemplary diagram illustrating a software architecture for providing multiple screens according to an implementation of the present invention.

  Referring to FIG. 15, a software architecture 1100 according to the present invention includes a device driver layer 1110, an API layer 1120, and an application layer (ApplicationLayer) 1130.

  The device driver layer 1110 receives and decodes service components constituting a service from various sources providing multimedia content. At this time, the service component includes video information, audio information, data information, or the like.

  The API layer 1120 generates logical screens, overlay screens, and output screens, and performs mapping or overlaying between services, logical screens, overlay screens, and output screens.

  The application layer 1130 provides a user interface that allows a user to dynamically configure a logical screen and an overlay screen on which a service is expressed, or transmits a user command to the API layer 1120 to perform an operation according to the command. be able to.

  On the other hand, the user can use the device driver layer 1110 through the application layer 1130 to output an output screen through a physical display screen or record it on a recording medium. The device driver layer 1110 can also transmit the output screen to other devices via the network.

  To this end, the device driver layer 1110 may include a plurality of output ports that provide the output screen, but a plurality of output ports may exist in the API layer 1120.

  On the other hand, in order to dynamically configure multiple logical screens on the output screen, the API layer 1120 may include multiple software modules, but here the 'MultiScreenManager' module, the 'MultiScreenContext' module, the 'MultiScreenContextListener' The 'module and the' MultiScreenContextEvent 'module will be described as an example, and the relationship between such modules is shown in FIG.

  The 'MultiScreenManager' module 1210 manages the 'MultiScreenContext' module and searches for a desired screen, informs device sharing information between screens, or plays a role of registering or canceling the 'MultiScreenContextListener' module 1250.

  The 'MultiScreenContext' module 1230 is an interface object associated with the screen object 1220. By the interface operation of the 'MultiScreenContext' module 1230, the types of screen objects are determined as a logical screen, an overlay screen, and an output screen. The various attribute information shown in FIG. The ‘set’, ‘add’, ‘get’ and ‘remove’ interfaces may be provided by the ‘MultiScreenContext’ module 1230.

  The 'MultiScreenContextEvent' module 1240 is an event class for notifying when the attribute information of the screen object 1220 is changed by the interface object of the 'MultiScreenContext' module 1230, and the 'MultiScreenContextListener' module 1250 is the 'MultiScreenContextListener' module 1250. This is a listener interface object that can be implemented in a predetermined application class to receive an event.

  On the other hand, the application 1260 is a module that operates in the application layer 1130. The application 1260 allows the user to select a desired service, and freely arranges a plurality of logical screens or overlay screens in a desired form on the output screen.

  Therefore, if the user transmits an instruction regarding dynamically arranging and managing a logical screen or an overlay screen to the MultiScreenManager module 1210, the MultiScreenManager module 1210 responds to the instruction through the MultiScreenContext module 1230. Let the action take place.

  Meanwhile, the MultiScreenContext module 1230 can manage the attribute information of the screen object 1220 shown in FIGS. 9A and 9B in association with the screen object 1220, and can include various functions or methods for such management.

  Meanwhile, the MultiScreenManager module 1210 may receive service components provided from various sources from the device driver layer 1110 and operate to be represented as a logical screen or an output screen. Of course, such a function may be performed through a separate module (not shown).

  FIG. 17 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG.

  First, the MultiScreenManager module 1210 generates one output screen and logical screens and overlay screens as many as the number of services to be performed (S1310).

  Next, the MultiScreenManager module 1210 links each logical screen and overlay screen with the service received from the device driver layer 1110 (S1320). At this time, the ‘addServiceContext’ method of the logical screen object and the ‘addServiceContext’ method of the overlay screen object can be called for each logical screen and overlay screen using the service context object for the service to be linked as a parameter. Here, the 'addServiceContext' method is understood as a method for performing a function of connecting a logical screen and an overlay screen and a service, and may be provided by the MultiScreenContext module 1230.

  The 'addServiceContext' method is called 'voidaddServiceContext (javax.tv.service.selection.ServiceContext context, booleanshowCC) throws java. lang. SecurityException, java. lang. Although it can be expressed in the form of IllegalStateException, the parameter 'showCC' is a Boolean parameter for determining the use of the overlay screen. If showCC is true, the 'addServiceContext' method is passed through the overlay screen. If subtitles are indicated and showCC is false, the 'addServiceContext' method causes the application to be executed through the overlay screen.

  If the logical screen and the overlay screen are connected to the service, the MultiScreenManager module 1210 connects each logical screen and the overlay screen to the output screen (S1330). At this time, the ‘setDisplayScreenDisplayDisplayScreen’ method of the logical screen object can be called for each logical screen using the output screen object to be connected as a parameter. Here, the 'setDisplayScreenDisplayDisplayScreen' method is understood as a method for performing a function of connecting a logical screen and an output screen, and can be provided by the MultiScreenContext module 1230. In addition, the overlay screen can call the 'setOverlayInformation' method of the overlay screen object. Here, the 'setOverlayInformation' method is understood as a method for performing a function of notifying that it is an overlay screen, and can be provided by the MultiScreenContext module 1230.

  For example, the 'setDisplayScreen' method is represented in the form of 'public void setDisplayScreen (HSScreen screen) throws SecurityException, IllegalStateException', which has the function 'represented as a function' as the parameter 'c'. provide. At this time, the 'HSScreen' instance is preferably an output screen.

  The parameter of the 'setDisplayScreen (HSScreen screen)' method may include 'NULL'. In this case, if the 'setDisplayScreen (HSScreen screen)' method is executed without exception handling, the current logical screen is , No more associated with the output screen.

  Then, as exception processing for the ‘setDisplayScreen (HSScreen screen)’ method, a ‘SecurityException’ exception and an ‘IllegalStateException’ exception are performed.

  The 'IllegalStateException' exception is that the current screen is not a logical screen, or the output screen provided for a parameter due to the characteristics of the hardware or software platform is associated with a specific logical screen, and the current logical screen falls under the parameter This is done when it cannot be associated with the output screen.

  If a service is combined with a logical screen and an overlay screen, and a plurality of logical screens and overlay screens are combined with one output screen, an area of the output screen on which each logical screen is represented, and an output screen on which the overlay screen is represented Is set (S1340). At this time, for each logical screen and overlay screen, a method provided by the MultiScreenContext module 1230 can be called to set the area shown in the output screen.

  FIG. 18 is a flowchart showing a process of exchanging services expressed on the logical screen by the modules shown in FIG.

  First, the MultiScreenManager module 1210 temporarily suspends the services existing on the two logical screens where the services are exchanged with each other (S1410).

  Next, the service information linked to the two logical screens is exchanged (S1420). At this time, the service context set in the logical screen can be exchanged by calling the 'removeServiceContext' method and the 'addServiceContext' method for each of the two logical screen objects. Here, the 'removeServiceContext' method is understood as a method for performing a function for removing a service context connected to a logical screen, and the 'addServiceContext' method is a method for performing a function for adding a new service context to the logical screen. It is understood that the 'removeServiceContext' method and the 'addServiceContext' method may be provided by the MultiScreenContext module 1230. That is, in the present invention, not only the effect of exchanging the main screen and the sub screen with each other by exchanging information about services connected to the logical screen, but also, for example, three or more services are displayed on the display screen. Even during execution, services can be exchanged between any number of logical screens.

  If the information of the service connected to the two logical screens is exchanged, an event that the connection between the service and the logical screen is changed occurs (S1430), and then the 'MultiScreenContextEvent' module 1240 displays the generated event as' The execution of the service newly transferred to the two logical screens is transmitted to the MultiScreenContextListener 'module 1250 (S1440).

  The embodiments of the present invention have been described above with reference to the accompanying drawings. However, those skilled in the art can implement the present invention in other specific forms without changing the technical idea and essential features thereof. You will understand that you can. Accordingly, it should be understood that the embodiments described above are illustrative in all aspects and not limiting.

  According to the present invention, a plurality of services obtained from cables, satellites, terrestrial broadcasts, various recording media, external inputs, and the like can be expressed in various forms through a physical display screen.

It is an illustration figure which shows the form which arrange | positions a main screen and a subscreen on a physical display screen by the prior art. It is an illustration figure which shows the form which arrange | positions a main screen and a subscreen on a physical display screen by the prior art. It is an illustration figure which shows the form which arrange | positions a main screen and a subscreen on a physical display screen by the prior art. It is an illustration figure which shows the form which arrange | positions a main screen and a subscreen on a physical display screen by the prior art. It is an illustration figure which shows the form which arrange | positions a main screen and a subscreen on a physical display screen by the prior art. It is an illustration figure which shows the form which arrange | positions a main screen and a subscreen on a physical display screen by the prior art. FIG. 4 is an exemplary diagram illustrating a relationship between a logical screen, an overlay screen, and an output screen according to an exemplary embodiment of the present invention. It is a figure which shows the structure of a screen provided with the mapper by one Embodiment of this invention. It is a figure which shows the structure of a screen provided with the mapper by one Embodiment of this invention. It is a figure which shows the structure of a screen provided with the mapper by one Embodiment of this invention. It is a figure which shows the structure of a screen provided with the mapper by one Embodiment of this invention. It is a figure which shows the structure of a screen provided with the mapper by one Embodiment of this invention. FIG. 6 is an exemplary diagram illustrating a method of independently overlaying various graphic contents on an output screen according to an exemplary embodiment of the present invention. FIG. 6 is an exemplary diagram illustrating a method of independently overlaying various graphic contents on an output screen according to an exemplary embodiment of the present invention. FIG. 6 is an exemplary diagram illustrating a method of independently overlaying various graphic contents on an output screen according to an exemplary embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating a method of using a plurality of graphic planes in one overlay screen according to an exemplary embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating a method of using a plurality of graphic planes in one overlay screen according to an exemplary embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating a method of using a plurality of graphic planes in one overlay screen according to an exemplary embodiment of the present invention. It is a figure which shows the example of application of the overlay screen by one Embodiment of this invention. It is a figure which shows the example of application of the overlay screen by one Embodiment of this invention. FIG. 6 is an exemplary diagram illustrating an example of a source providing a service according to an embodiment of the present invention. FIG. 6 is an exemplary diagram illustrating an example of an abstract service and a non-abstract service according to an embodiment of the present invention. FIG. 6 is an exemplary diagram illustrating an example of an abstract service and a non-abstract service according to an embodiment of the present invention. It is an exemplary diagram showing attribute information and interface types on a logical screen and an overlay screen. It is an exemplary diagram showing attribute information and interface types on a logical screen and an overlay screen. FIG. 4 is an exemplary diagram illustrating a 'z-order' attribute of a logical screen and an overlay screen. FIG. 6 is an exemplary diagram illustrating a “Display_Area” attribute of a logical screen. FIG. 6 is an exemplary diagram illustrating a “Display_Area” attribute of a logical screen. FIG. 5 is an exemplary diagram illustrating a process in which three services are mapped to one output screen and output. 1 is a block diagram illustrating a configuration of an apparatus for providing a multiple screen according to an embodiment of the present invention. 6 is a flowchart illustrating a method for dynamically configuring multiple screens according to an embodiment of the present invention. FIG. 3 is an exemplary diagram illustrating a software architecture for providing multiple screens according to an embodiment of the present invention. FIG. 4 is an exemplary diagram illustrating a relationship between modules constituting an API layer according to an exemplary embodiment of the present invention. FIG. 17 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen and an overlay screen by the modules illustrated in FIG. 16 according to an exemplary embodiment of the present invention. 17 is a flowchart illustrating a process of exchanging services represented on a logical screen by each module illustrated in FIG. 16 according to an exemplary embodiment of the present invention.

Claims (47)

A digital signal processing module that receives video information, audio information, or data information and restores a service based on the video information, the audio information, or the data information;
A service processing module for generating a plurality of output screens, a plurality of logical screens and an overlay screen representing the restored service;
An apparatus for providing a multi-screen comprising: an output module that maps the generated plurality of logical screens in different positions in an output screen and overlays the generated overlay screen on the output screen.   The apparatus of claim 1, wherein the video information, the audio information, or the data information is provided by a broadcast signal, a recording medium, or a network.   The apparatus for providing a multi-screen according to claim 2, wherein the data information includes application information regarding an application existing in the service, and the application information includes information indicating whether the application can be performed on a PiP screen. .   The apparatus of claim 1, wherein the logical screen has information about a region disposed on the output screen.   The apparatus of claim 1, wherein the logical screen has identification information of the output screen.   The apparatus for providing a multi-screen according to claim 1, wherein the overlay screen has identification information of the overlay screen informing that it is an overlay screen.   The multi-screen according to claim 1, wherein each of the logical screen and the overlay screen has information about an associated service context, and a service represented in the logical screen and the overlay screen is set in the service context. Providing device.   The apparatus of claim 1, wherein the output screen has identification information of the logical screen.   The apparatus of claim 1, further comprising a display screen that outputs the output screen.   The apparatus for providing a multi-screen according to claim 1, further comprising a recording medium for recording the output screen.   The apparatus of claim 1, further comprising an external output module configured to transmit the output screen to a predetermined device. A service processing module that generates an output screen, a logical screen, and an overlay screen on which a service is represented, and associates the logical screen and the overlay screen with the service;
An apparatus for providing a multi-screen comprising: an output module that maps the generated logical screen to a predetermined area in the generated output screen and overlays the generated overlay screen on the generated output screen.   The apparatus of claim 12, wherein the service includes at least one of video information, audio information, and data information.   The apparatus of claim 13, wherein the video information, the audio information, or the data information is provided by a broadcast signal, a recording medium, or a network.   14. The apparatus for providing a multi-screen according to claim 13, wherein the data information includes application information regarding an application existing in the service, and the application information includes information indicating whether the application can be performed on a PiP screen. .   The apparatus of claim 12, wherein the logical screen has information about a region disposed on the output screen.   The apparatus of claim 12, wherein the logical screen has identification information of the output screen.   The apparatus for providing a multi-screen according to claim 12, wherein the overlay screen has identification information of the overlay screen informing that it is an overlay screen.   The multi-screen according to claim 12, wherein each of the logical screen and the overlay screen has information about an associated service context, and the service context is set with a service represented on the logical screen and the overlay screen. Providing device.   The apparatus of claim 12, wherein the output screen has identification information of the logical screen.   The apparatus of claim 12, further comprising a display screen for outputting the output screen.   The apparatus of claim 12, further comprising a recording medium that records the output screen.   The apparatus as claimed in claim 12, further comprising an external output module for transmitting the output screen to a predetermined device. A digital signal processing module that receives video information, audio information, or data information and restores a service based on the video information, the audio information, or the data information;
A service processing module for generating an output screen, a logical screen and an overlay screen representing the restored service;
An apparatus for providing a multi-screen comprising: an output module that maps the generated logical screen to a predetermined area in an output screen and overlays the generated overlay screen on the output screen. Receiving video information, audio information or data information;
Restoring a service based on the video information, the audio information or the data information;
Generating an output screen, a plurality of logical screens and an overlay screen for representing the service;
Mapping the generated plurality of logical screens in different positions in the output screen;
Overlaying the generated overlay screen on the output screen.   The method of claim 25, wherein the video information, the audio information, or the data information is provided by a broadcast signal, a recording medium, or a network.   27. The method of providing a multi-screen according to claim 26, wherein the data information includes application information regarding an application existing in the service, and the application information includes information indicating whether the application can be performed on a PiP screen. .   26. The method of claim 25, wherein the logical screen has information about an area disposed on the output screen.   26. The method according to claim 25, wherein the logical screen has identification information of the output screen.   26. The method of claim 25, wherein the overlay screen has overlay screen identification information indicating that it is an overlay screen.   The multi-screen according to claim 25, wherein each of the logical screen and the overlay screen has information about an associated service context, and the service context is set with a service represented by the logical screen and the overlay screen. Dynamic configuration method.   26. The method according to claim 25, wherein the output screen has identification information of the logical screen.   26. The method of claim 25, further comprising outputting the output screen.   26. The method of claim 25, further comprising storing the output screen.   The method of claim 25, further comprising transmitting the output screen to a predetermined device. Generating an output screen, a logical screen and an overlay screen on which the service is represented;
Mapping the generated logical screen to a predetermined area in the generated output screen;
Overlaying the overlay screen on the output screen.   38. The method of claim 36, wherein the service includes at least one of video information, audio information, and data information.   38. The method for providing a multi-screen according to claim 37, wherein the data information includes application information regarding an application existing in the service, and the application information includes information indicating whether the application can be performed on a PiP screen. .   The method of claim 36, wherein the service is provided by a broadcast signal, a recording medium, or a network.   38. The method of claim 36, wherein the logical screen has information about a region disposed on the output screen.   37. The method of claim 36, wherein the logical screen has identification information of the output screen.   37. The method of claim 36, wherein the overlay screen has overlay screen identification information that informs the user that it is an overlay screen.   The multi-screen according to claim 36, wherein the logical screen and the overlay screen have information about an associated service context, and the service context is configured with a service represented by the logical screen and the overlay screen. Dynamic configuration method.   The method of claim 36, wherein the output screen has identification information of the logical screen.   38. The method of claim 36, further comprising outputting the output screen.   38. The method of claim 36, further comprising storing the output screen.   38. The method of claim 36, further comprising transmitting the output screen to a predetermined device.