KR20070100136A - Apparatus and method for multiple screen - Google Patents

Abstract

An apparatus and a method for providing multiple screens are provided to express plural services, obtained from a cable, satellite, terrestrial broadcast, various storage media, external input, and so on, through a physical display screen and to output audio contents supplying to each service by independently selecting the audio contents. An apparatus for providing multiple screens comprises the followings: a service processing module(950) for providing plural services; an interface module(965) for receiving a designation command of second audio content as a focus object among first audio contents assigned to each of the plural services; and an output module(960) for outputting the second audio contents focused according to the designation command.

Description

Apparatus and method for multiple screen providing device and method

The present invention relates to providing multiple screens, and more particularly, to an apparatus and method for providing a plurality of services through a plurality of screens dynamically configured in a physical display screen.

In a conventional broadcast receiver such as a digital TV or a digital set-top box, only one content is displayed on one physical display screen, or two main screens and a sub-screen are displayed on one physical display screen. It is common to show the screen at the same time.

In this case, even when the main screen and the sub-screen are simultaneously displayed, the two screens may be arranged only in a predetermined manner by the broadcast receiving apparatus. And only in the case of the content shown on the main screen, all elements constituting the content (video, audio, data, or a combination thereof) are played, and only some elements constituting the content are limitedly played through the sub-screen.

In addition to the broadcast services such as satellite broadcasting, terrestrial broadcasting, and cable broadcasting as a source for providing contents, there are a storage medium such as a DVD or an external device connected to an external input terminal, and the like. It is also fixed on a limited basis.

On the other hand, in an application program environment for an interactive TV such as a multimedia home platform (MHP), an advanced common application platform (ACAP), an open cable application platform (OCA), and the like, a screen that is generally output through a physical display screen Is assumed to be one.

For example, the application program environment for interactive TV employs a user interface (UI) structure according to the HAVi (Home Audio / Video Interoperability) standard. However, the HAVi UI standard does not limit the number of screens. However, in actual use, it is common to assume that there is only one screen output through the display screen.

In such an environment, a plurality of contents are displayed through a plurality of independent screens, and at the same time, decoding, digital signal processing, user interaction processing, and the like on the contents represented on each screen are performed dynamically, It is difficult to control life-cycle and resource usage on each screen.

Accordingly, there is a need for a method for configuring and providing various contents on a display screen in various ways.

An object of the present invention is to provide an apparatus and method for providing a service through a screen dynamically configured on a physical display screen.

In addition, an object of the present invention is to provide a method for independently selecting and outputting audio content provided for each service.

The object of the present invention is not limited to the above-mentioned object, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a multi-screen providing apparatus according to an exemplary embodiment of the present invention provides a service processing module for expressing a plurality of services and a second audio content that is the focus target among first audio contents assigned to each of the plurality of services. An interface module for receiving a designation command and an output module for outputting the second audio content focused according to the designation command.

In order to achieve the above object, the multi-screen providing apparatus according to an exemplary embodiment of the present invention provides a service processing module representing a plurality of services and an output property of first audio content assigned to each of the plurality of services. And an output module configured to output second audio content set as an output target among the audio content.

In order to achieve the above object, the multi-screen providing method according to an embodiment of the present invention comprises the steps of expressing a plurality of services, and designation command of the second audio content that is the focus of the first audio content assigned to each of the plurality of services And receiving the focused second audio content according to the designation command.

In order to achieve the above object, the multi-screen providing method according to an embodiment of the present invention is a step of expressing a plurality of services, confirming the output properties of the first audio content assigned to each of the plurality of services and the confirmation And outputting second audio content set as an output target among the first audio contents with reference to the output attribute.

Specific details of other embodiments are included in the detailed description and the drawings.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims.

Hereinafter, the present invention will be described with reference to a block diagram or a flowchart illustrating a multi-screen providing apparatus and method according to embodiments of the present invention. At this point, it will be understood that each block of the flowchart illustrations and combinations of flowchart illustrations may be performed by computer program instructions. Since these computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, those instructions executed through the processor of the computer or other programmable data processing equipment may be described in flow chart block (s). It will create means to perform the functions. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in the flowchart block (s). Computer program instructions It is also possible to mount on a computer or other programmable data processing equipment, so that a series of operating steps are performed on the computer or other programmable data processing equipment to create a computer-implemented process to perform the computer or other programmable data processing equipment. It is also possible for the instructions to provide steps for performing the functions described in the flowchart block (s).

In addition, each block may represent a portion of a module, segment, or code that includes one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative implementations, the functions noted in the blocks may occur out of order. For example, the two blocks shown in succession may in fact be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the corresponding function.

On the other hand, in order to facilitate the description of the present invention to define the basic concepts related to the present invention.

'Service' is a multimedia content represented by a bundle, and a plurality of service components make up a service.

The 'service component' is a part constituting a service, and includes a video component, an audio component, a data component, and the like. At this time, the data component refers to an application program existing in a service.

In addition, an application may be classified into an unbound application and a service bound application. Since the unbound application is not related to a specific channel, execution of the application is not affected by channel switching. Also, since they usually have a high priority, resources for execution are smoothly allocated. The monitor application is a special unbound application that can have the highest priority.

Service-bound applications, on the other hand, are related to transport streams and are generally given a lower priority than unbound applications. Service bound applications do not perform critical system functions and are more likely to give up resource allocation than unbound applications if contention for resources occurs. There are two types of service-bound applications that operate in conjunction with the current stream and non-interworking that operate independently of the stream being transmitted.

'Service context' includes various resources, devices, and execution state information related to executing a service, and includes an object that can control the execution of a service. Indicates.

The 'display display (physical display device)' refers to the physical device (device) in which the contents of the service are actually expressed, the external output port on which the contents of the service are output, or the storage device in which the service is stored. .

An 'display screen' is a screen that is actually output on a display screen, in which any service is set directly on the output screen and represented through the display screen, or at least one logical screen mapped to a certain area of the output screen is displayed. It is output through the screen.

The 'logical screen' is a space in which an arbitrary service is represented and exists virtually only in memory before being mapped to an output screen and is not represented on an actual display screen.

In addition, the logic screen and the output screen may consist of a combination of a background still image, a video ratser and a graphic raster, where the graphic raster is text. ), Lines, colors and images may be synthesized or video frames may be provided in a mixture.

The 'main service' refers to a service selected by the user as a main service through a menu or a remote control displayed on the display screen or by an application through an API, and refers to a screen on which the main service is represented. It is called.

"PiP service" means a service that the user has selected as a subservice within the main screen via a menu or remote control that appears on the display screen or through an API, and the PiP service is a "PiP screen ( Picture-in-Picture screen) 'or the main screen.

'PiP Screen (Picture-in-Picture screen)' is a screen occupying some area in another screen as shown in Figs. 1A to 1D, and in Figs. A screen that is simultaneously shown in an area that does not overlap with another screen as shown, and also overlaps with another screen at any position and area on the display screen as shown in FIGS. 1G and 1H. It may be understood as a concept including a screen to be represented.

2 is an exemplary view showing a relationship between a logic screen and an output screen according to an embodiment of the present invention.

Referring to FIG. 2, a service may be represented through logic screens 210, 212, and 214, which are then mapped and represented by output mappings 220, 222, and 224 by a predetermined mapping block 230. Can be.

In this case, the output screen referred to as 220 is represented by mapping logic screens referred to as 210 and 212, and the output screen referred to as 222 is represented as mapped logical logic screens referred to as 212 and 214, and referred to as 224. The output screen is mapped with the logical screens referred to as 210, 212 and 214.

As such, at least one logical screen on which the service is represented may be mapped to any area of the output screen by the mapping block 230.

Meanwhile, the mapping block 230 may be understood as a collection of various information for mapping the logical screen and the output screen. Examples of such information may include coordinate information of an area where the logical screen is mapped to the output screen, identification information for distinguishing the logical screen from the output screen, information about the order in which the plurality of logical screens are displayed on the output screen, and the like. .

The mapping block 230 may change the size of the logical screen and allocate the same to a predetermined area of the output screen. That is, the mapping block 230 may perform a scaling function and a position allocation function for a logical screen, and FIG. 3A to FIG. 3E illustrate a configuration of a screen including such a mapping block, that is, a mapper. .

Referring to FIG. 3A, a main screen composed of a combination of a background still image (B), a video ratser (V), and a graphic raster (G) is defined by a mapper. It is mapped to the entirety of the output screen while maintaining the size. PiP screens with only video components are mapped to a given area of the output screen as their size is reduced by a mapper. At this point, the mapped PiP screen is placed on the main screen, which is determined by the Z value. Z denotes a z-order value, and the z-order will be described later. In addition, an overlay screen can be composited with the output screen, which is the outermost special screen that can be used, for example, when it is necessary to provide a caption. The PiP screen may have only video components as in FIG. 3A, but as shown in FIG. 3B, a background still image (B), a video ratser (V), and a graphic raster are shown. It may consist of a combination of (G).

Referring to FIG. 3C, a main screen made up of a combination of background still image (B), video raster (V) and graphic raster (G) is mapped by the mapper to the entirety of the output screen while maintaining its size. The two PiP screens # 1 and # 2 having only the video component are each mapped by a mapper to a certain area of the output screen as their size is reduced. At this time, the mapped PiP screens are placed on the main screen, and the Z value can remain the same. In addition, an overlay screen can be combined with the output screen. The screen configuration may include a plurality of PiP screens having only video components as in FIG. 3C, but as shown in FIG. 3D in a combination of background still image (B), video raster (V) and graphic raster (G). It may also consist of a plurality of PiP screens.

In FIG. 3E, a POP screen is illustrated. If the conventional PiP screen is a screen displayed inside the main screen, the POP screen may be understood as a screen displayed outside the main screen. Referring to FIG. 3E, a plurality of POP screens # 1 and # 2 having a combination of a background still image (B), a video raster (V), and a graphic raster (G) are each sized by a mapper. It gets smaller and maps to a certain area of the output screen. At this time, the Z values of the mapped POP screens # 1 and # 2 may be kept the same. In addition, an overlay screen may be represented by being synthesized with the output screen.

In addition, the mapping block 230 may be implemented as an interface, a function, or the like, which is written and executed in various computer program languages. The mapping block 230 may generate or change a relationship between the logical screen and the output screen using the above information as a parameter.

In addition, the mapping block 230 may be implemented in hardware to perform a mapping function between the logical screen and the output screen.

In the output screen, services provided from various sources may be represented and output through a display screen, which is illustrated in FIG. 4.

Generally, as a source for providing a service, there is a source for providing a broadcast service such as terrestrial broadcasting 320 or cable broadcasting 330, and a service stored in a predetermined storage medium such as a personal video recorder (PVR) 340. There is also a source available. In addition, although not shown in FIG. 4, a source for providing a service through a wired or wireless network may also be included.

At this time, the broadcast receiving device 310 receives a service from these sources, and generates a logical screen representing each service.

Then, according to a preset method, a method set by a user or an application, any service is directly set on the output screen and represented through the display screen, or at least one logical screen mapped to a certain area of the output screen is displayed on the display screen ( Through 350).

 In FIG. 4, the services provided by the terrestrial broadcast 320, the cable broadcast 330, and the PVR 340 are represented through the display screen 350.

In FIG. 4, as an example of a source for providing a service, a terrestrial broadcast 320, a cable broadcast 330, and a personal video recorder (PVR) 340 are illustrated, but a source for providing a service is not limited thereto. If it provides multimedia content represented by a bundle of may be included in the source in the present invention.

Meanwhile, the services of the present invention include an abstract service and a non-abstract service, which are illustrated in FIGS. 5A and 5B, respectively.

An abstract service is an independent service for a broadcast channel, not a service delivered in real time from a broadcast signal. The abstract service is an abstract service that includes only a data component, that is, an application program, without a video component or an audio component. It may correspond to a service. For example, services that consist of unbound applications in the Open Cable Application Platform (OCAP) specification fall into this category.

A non-abstract service can be understood as a service other than an abstract service.

In the present invention, independence may be provided for each of the abstract service and the non-abstract service. For example, an abstract service may be set on an output screen directly without going through a logical screen, and a non-abstract service may be represented on a logical screen and mapped to an output screen on which an abstract service is set. The output screen can then be output via the display screen, whereby the abstract and non-abstract services can be represented independently on one output screen. In addition, both abstract and non-abstract services may be mapped to separate logical screens, and then each logical screen may be mapped to one output screen. In other words, the abstract service and the non-abstract service may be represented on the output screen as independent forms.

Meanwhile, in the present invention, the logical screen and the output screen may be defined as separate objects, but the screen may function as the logical screen or the output screen according to the attribute information of one object called the screen. have.

That is, it is possible to know whether the screen is a logical screen or an output screen through type information among attribute information about the screen object.

As attribute information of the screen object, there are attribute information such as' Type ',' z-Order ',' Display_Area ',' Visibility ',' Associated_Display_Screen ',' Associated_Service_Contexts', Associated_Logical_Screens', and 'OutputPort'.

6 shows the attribute information of the screen object and the type of interface for processing the attribute information.

'Type' attribute 510 is attribute information indicating whether the screen is a logical screen or an output screen.

The 'z-Order' attribute 520 is for determining the order on the z-axis when the logical screens are represented on the output screen, and in FIG. 7 illustrates how the logical screen appears according to the z-order attribute on the output screen. Doing.

In FIG. 7, the first logical screen 620 and the second logical screen 630 are mapped to a certain area on the output screen 610. At this time, the first logical screen 620 is represented on the output screen, and the second logical screen 630 is represented above it. That is, in the z-axis direction, the output screen 610, the first logical screen 620, and the second logical screen 630 are expressed in the order of the z-order attribute value of the first logical screen 620. With this 1, the z-order attribute value of the second logical screen 620 can be set to 2. At this time, the z-order attribute value can be in any number or character form as long as it indicates the order in which the logical screen is expressed on the z axis of the output screen.

The 'Display_Area' property 530 indicates information about an area of an output screen to be output by mapping a logical screen to an output screen, which is illustrated in FIGS. 8A and 8B.

FIG. 8A illustrates that the logic screen 710 is mapped to the entire area of the output screen 720 and is output. FIG. 8B illustrates that the logic screen 730 is mapped and output to a partial area of the output screen 740. have.

In this case, the information indicating the 'Display_Area' property may be two-dimensional coordinate information on the output screen, or may be expressed as a specific position on the output screen and an offset value from the specific position.

The 'Visibility' attribute 540 is an attribute that determines whether or not the logical screen is to be shown on the output screen. By changing this attribute value, the logical screen can be made visible or disappeared on the physical display screen.

The 'Associated_Display_Screen' property 550 indicates identification information of output screens associated with the logical screen. Logical screens that are not connected to an output screen are not shown on the display screen or sent to other external outputs.

The 'Associated_Service_Contexts' attribute 560 represents information about service contexts associated with the logical screen or output screen itself, with the service set in the service context being represented on the logical screen or output screen.

The 'OutputPort' attribute 570 indicates information about an object on which an output screen is output, and may include a display screen, a wired / wireless communication medium, and various storage media as the object on which the output screen is output.

Meanwhile, interfaces for acquiring or changing the value of the attribute information shown in FIG. 6 may be provided, as shown in FIG. 6, setting a value of the attribute information or connecting a logical screen to an output screen. 'Set' interface to add the value of the property information or 'add' interface to connect the logical screen with the service, 'get' interface to get the value of the property information, '' to delete the value of the property information remove 'interface. Such an interface may be understood as a process, a function, a procedure, a method, or the like that performs each function.

For example, the 'getDisplayScreen (void)' method functions to return an output screen associated with the current screen. For example, if the current screen is a logical screen, the associated output screen is returned. If the current screen is an output screen, reference information about the current screen is returned. If the current screen is a logical screen but no associated output screen exists. Returns null.

As another example, the 'public void setDisplayArea (HScreenRectangle rect) throws SecurityException, IllegalStateException' method provides the ability to map the current logical screen to a given area of the associated output screen. The instance provided as a parameter is a 'HScreenRectangle' class type of the 'org.havi.ui' package and has two-dimensional location information. As an exception for the 'setDisplayArea (HScreenRectangle rect)' method, an 'SecurityException' exception and an 'IllegalStateException' exception may be performed. An 'IllegalStateException' exception may be performed if the current screen is not a logical screen, or if the area of the output screen associated with the current logical screen cannot be changed due to the nature of the hardware or software platform.

As another example, the 'getOutputArea (void)' method returns information about the current screen area in the form of the 'HScreenRectangle' class. If the current screen is an output screen, 'HScreenRectangle' information having the same value as 'HScreenRectangle (0,0,1,1)' is returned. If the current screen is a logical screen, the associated output screen is returned. Information about the area occupied by the logical screen is returned. If the current screen is a logical screen but there is no associated output screen, then a NULL value is returned.

Each interface name mentioned above is merely a name for indicating each function, and should not be limited to the name but should be understood as the function.

9 is an exemplary diagram illustrating a process in which two services are respectively set in two logical screens and mapped and output in one output screen.

Referring to FIG. 9, the first service is a service in which all three service components of video / audio / data exist, and the second service is an example in which only a video component and an audio component exist. Of course, the present invention does not place any restrictions on the service component, and FIG. 9 shows one possible example.

As shown in FIG. 9, the first service and the second service appear on the display screen in a similar manner to the conventional method, but according to the present invention, a plurality of services can be applied to the display screen without any number through mapping. Can be expressed independently in various positions.

10 is a block diagram showing the configuration of a multi-screen providing apparatus according to an embodiment of the present invention.

Referring to FIG. 10, the multi-screen providing apparatus 900 according to the present invention includes a digital signal processing module 940, a service processing module 950, an output module 960, and a user / application interface module 965. .

In this case, a source for supplying a service may include a broadcast signal receiving module 910, a storage medium 920, or an external input module 930, and the display screen 970 as a medium for outputting a service. Storage media 980 or an external output module 990.

In this case, the term 'module' used in the present embodiment refers to software or a hardware component such as an FPGA or an ASIC, and a module plays a role. However, modules are not meant to be limited to software or hardware. The module may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a module may include components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, subroutines. , Segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules. In addition, the components and modules may be implemented to play one or more CPUs in a device or secure multimedia card.

The digital signal processing module 940 includes various configuration information constituting a service such as multimedia content from the broadcast signal receiving module 910, the storage medium 920, or the external input module 930, for example, video information and audio information. Or data information or the like.

In this case, the broadcast signal receiving module 910 is a module for receiving and transmitting satellite, terrestrial or cable broadcast signals, and the storage medium 920 represents a device storing video information, audio information, or data information constituting a service. The external input module 930 may be understood as a module that receives and transmits video information, audio information, or data information constituting a service from another networked device such as a network interface module.

The digital signal processing module 940 restores a service by using the received service components, and may restore a plurality of services. At this time, the restored service includes an abstract service or a non-abstract service.

In addition, the term 'plural services' may mean, for example, two or more services delivered by the broadcast signal receiving module 910, and may be delivered from each of the broadcast signal receiving module 910 and the storage medium 920. It may mean two or more services.

The service restored by the digital signal processing module 940 may be restored according to the selection of a user or an application through the user / application interface module 965. At this time, the user or the application may select which service to connect to which screen.

The service processing module 950 generates a logical screen and an output screen for representing the service restored by the digital signal processing module 940.

The output module 960 maps and outputs the logical screens generated by the service processing module 950 to a predetermined area on the output screen. At this point, the mapping onto the output screen may already be set or may be set by the user or application via the user / application interface module 965.

In addition, the service restored by the digital signal processing module 940 may be directly connected to the output screen instead of the logical screen in the service processing module 950 and output by the output module 960.

The output screen by the output module 960 may be output through the physical display screen 970 or may be stored in the storage medium 980. The storage medium 980 can be read by a computer and includes a floppy disk, hard disk, CD-ROM, DVD, DVD-ROM, Blu-ray Disc (BD) and semiconductor memory.

Also, it may be delivered to another device connected through a network through the external output module 990.

To this end, the output module 960 may comprise a number of output ports on which an output screen is provided, in which case the default output port already set or an output port designated via the user / application interface module 965. Through the output screen can be provided.

The user or application may allow the user / application interface module 965 to select or restore a desired service. In addition, the user or application may select any of the plurality of output screens via the user / application interface module 965.

Since each module illustrated in FIG. 10 is shown separately according to each function, the modules may be combined with other modules in an actual implementation.

11 is a flowchart illustrating a method of providing a service through multiple screens dynamically configured according to an embodiment of the present invention.

In general, video information, audio information, data information, etc. constituting multimedia content are delivered according to a predetermined format such as, for example, an MPEG stream. Therefore, the device executing the service such as the multimedia content receives the above information and restores the corresponding service (S1010). At this time, the service to be restored may be selected or preset by the user or the application. The user can select which service to connect to which screen by using a menu or remote control displayed on the display screen or by using an API.

Meanwhile, the data information includes application information about an application program existing in the service, and the application information includes signal information indicating whether the application program can be executed on the PiP screen. Examples of the application information include an application information table (AIT) according to the MHP standard and an eXtended Application Information Table (XAIT) according to the OCAP standard, and the signal information may be added to the application information.

Then, the restored service is set to be represented on the logical screen according to the present invention (S1020), the logical screen is mapped to the output screen according to the present invention (S1030), and then through a display screen, a storage medium or a network. The output screen is provided (S1040).

Meanwhile, although the restored service is represented as being provided through the output screen through the logical screen in FIG. 11, the restored service may be provided through the output screen directly without passing through the logical screen.

Although FIG. 11 illustrates a process in which one service is mapped to an output screen for convenience of description, a plurality of services are mapped to any area within one output screen directly or through a plurality of logical screens using screen attribute information. Can be. Therefore, when the output screen is provided through the display screen, the user or the application can execute a plurality of services.

Meanwhile, when the user or the application selects the PiP service, the multi-screen providing apparatus 900 may express the PiP service in two modes. The first mode is illustrated in FIG. 12A and the second mode is illustrated in FIG. 12B.

12A, in the first mode, no separate logical screen, eg, a PiP screen, for the PiP service is generated, but only a video component of the PiP service selected in the main screen is represented. At this time, in the first mode, the application associated with the PiP service is not executed or its operation is deactivated.

Referring to FIG. 12B, in the second mode, a separate logical screen for the PiP service is generated to represent the selected PiP service in the generated PiP screen. The PiP screen provided in the second mode may include a background video or a video component that serves as a desktop. In addition, unlike the first mode, the application associated with the PiP service may be executed in the second mode. At this time, whether the application can be executed may be determined by the signal information described above.

Preferably, the first mode and the second mode are not performed at the same time.

In addition, the above mode may be selected by a user input or an application through the user / application interface module 965. If the user or the application selects the first mode, the digital signal processing module 940 may select the selected PiP service. Reconstruct only the video component of, and the reconstructed video component is mapped to the main screen generated by the service processing module 950. Then, it is displayed through the output screen generated by the output module 960. If the user or the application selects the second mode, the digital signal processing module 940 restores the selected PiP service, and the restored service is mapped to the PiP screen generated by the service processing module 950. Then, it is displayed through the output screen generated by the output module 960.

On the other hand, the user or application through the user / application interface module 965 may be able to independently output the audio content of a specific service from among the services represented on a plurality of logical screens, the process shown in Figure 13 Is shown.

First, a user or an application selects a specific service through the user / application interface module 965 (S1310).

Then, the digital signal processing module 940 extracts the audio content within the selected service, and the extracted audio content is mapped to the output screen or the logical screen generated by the service processing module 950 and output to the output module 960. It can be output independently by (S1320). In this case, the term 'independent output' refers to, for example, audio content in a specific service simultaneously or exclusively with audio contents of services represented on another screen through an output port mapped with an output screen on which the specific service is represented. (exclusive) can be understood as a concept that includes being selected and delivered. It can be understood as 'independent output' that a plurality of audio contents in a plurality of services are output, represented or stored through different media. That is, the audio content does not necessarily have to be represented with other components in the same service, but may be independently expressed by a user or an application.

The output module 960 is selected by a user or an application or outputs audio content through a preset external output module 990.

In addition, when a plurality of audio content is selected, each audio content may be output independently and simultaneously through a separate external output module 990.

In addition, the user or application may select the desired audio content independently of other components in the same service via the user / application interface module 965. FIG. 14 is software for providing multiple screens in accordance with an embodiment of the present invention. This is an exemplary view showing the architecture.

Referring to FIG. 14, the software architecture 1400 according to the present invention may include a device driver layer 1410, an application program interface layer 1420, and an application layer 1430. Include.

The device driver layer 1410 receives and decodes service components that constitute a service from various sources that provide multimedia content. In this case, examples of the service component include video information, audio information or data information.

The API layer 1420 creates a logical screen and an output screen, and performs mapping between services, logical screens, and output screens.

The application layer 1430 may provide a user interface that allows a user to dynamically configure a logical screen on which a service is expressed, or may transmit a user's command to the API layer 1420 to perform an operation according to the command. have.

In addition, in the application layer 1430, audio contents provided by different services may be independently selected by a user or an application, and the selected audio contents may be independently output by the device driver layer 1410.

Meanwhile, the user may cause the device driver layer 1410 to output the output screen through a physical display screen or store the result in the storage medium through the application layer 1430. In addition, the device driver layer 1410 may transmit the output screen to another device via a network.

To this end, the device driver layer 1410 may include a plurality of output ports providing the output screen, but a plurality of output ports may exist in the API layer 1420.

Meanwhile, in order to dynamically configure a plurality of logical screens on an output screen, the API layer 1420 may include a plurality of software modules, wherein the 'MultiScreenManager' module, 'MultiScreenContext' module, 'MultiMultiScreencontextListener' module, and ' The MultiMultiScreencontextEvent 'module will be described as an example, and the relationship between these modules is shown in FIG.

The 'MultiScreenManager' module 1510 manages the 'MultiScreenContext' module, finds a desired screen, informs device sharing information between the screens, or serves to register or release the 'MultiMultiScreencontextListener' module 1550.

The 'MultiScreenContext' module 1530 is an interface object for the screen object in association with the screen object 1520. The screen type of the screen object may be determined as a logical screen and an output screen according to the interface operation of the 'MultiScreenContext' module 1530. The various attribute information shown in FIG. 6 may be set. The aforementioned 'set', 'add', 'get', and 'remove' interfaces may be provided by the 'MultiScreenContext' module 1530.

The 'MultiMultiScreencontextEvent' module 1540 is an event class for notifying when the property information of the screen object 1220 is changed by the 'MultiScreenContext' interface object 1230, and the 'MultiMultiScreencontextListener' module 1550 A listener interface object that can be implemented in a predetermined application class to receive an event by the 'MultiMultiScreencontextEvent' module 1540.

On the other hand, the application 1560 is a module that operates in the application layer 1430, allows the user to select the desired service, and freely arrange a plurality of logical screens on the output screen according to the desired form.

Thus, when the application 1560 passes commands to the MultiScreenManager module 1510 about the user dynamically placing and managing the logical screen, the MultiScreenManager module 1510 corresponds to the commands via the MultiScreenContext module 1530. Perform the action.

Meanwhile, the MultiScreenContext module 1530 may manage attribute information of the screen object 1520 illustrated in FIG. 6 in association with the screen object 1520, and may include various functions or methods for such management. .

Meanwhile, although not shown, the MultiScreenManager module 1510 may operate to receive service components provided from various sources from the device driver layer 1410 so that they may be represented on a logical screen or an output screen. Of course, this function may be performed through a separate module (not shown).

FIG. 16 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG. 15.

First, the MultiScreenManager module 1510 generates one output screen and as many logical screens as the number of services to be executed (S1610).

Then, the MultiScreenManager module 1510 connects each logical screen with a service received from the device driver layer 1410 (S1620). At this time, for each logical screen, the 'addServiceContext' method of the logical screen object may be called using the service context object for the service to be connected as a parameter. Here, the 'addServiceContext' method may be understood as a method that performs a function of connecting a logical screen and a service, and may be provided by the MultiScreenContext module 1530.

When the logical screen and the service are connected, the MultiScreenManager module 1510 connects each logical screen with the output screen (S1630). At this time, for each logical screen, the 'setDisplayScreen' method of the logical screen object may be called using the output screen object to be connected as a parameter. Here, the 'setDisplayScreen' method may be understood as a method that performs a function of connecting a logical screen and an output screen, and may be provided by the MultiScreenContext module 1530.

For example, the 'setDisplayScreen' method can be expressed in the form of 'public void setDisplayScreen (HScreen screen) throws SecurityException, IllegalStateException', which associates the provided 'HScreen' instance with the current logical screen. To provide. In this case, the 'HScreen' instance is preferably an output screen.

The parameter of the 'setDisplayScreen (HScreen screen)' method may include 'NULL'. In this case, when the 'setDisplayScreen (HScreen screen)' method is executed without exception handling, the current logical screen is no longer present. It is not associated with an output screen.

As an exception for the 'setDisplayScreen (HScreen screen)' method, an 'SecurityException' exception and an 'IllegalStateException' exception may be performed.

An 'IllegalStateException' exception can be used to associate the current logical screen with an output screen corresponding to that parameter because the current screen is not a logical screen or an output screen provided as a parameter due to the nature of the hardware or software platform is associated with a particular logical screen. May be performed if none.

When a service and a logical screen, and a plurality of logical screens and one output screen are connected, an area of an output screen where each logical screen is to be represented is set (S1640). At this time, for each logical screen, a method provided by the MultiScreenContext module 1530 may be called to set an area to be displayed on the output screen.

17 is a flowchart illustrating a process of outputting audio content according to an embodiment of the present invention.

As described above, the service processing module 950 represents a plurality of services, and one of audio contents allocated to each of the plurality of services may be focused by a user or an application.

That is, the user or the application may input a designation command of the audio content that is the focus target, and the user / application interface module 965 serves to receive the input designation command (S1710).

The 'assignAudioFocus' method may be called to specify focus on specific audio content. The 'assignAudioFocus' method is a method for focusing one selected audio content among a plurality of audio contents and provided by the MultiScreenContext module 1530. Can be.

As the focus of the audio content is designated, the output module 960 outputs the focused audio content in operation S1730. In this case, the output module 960 may check the audio content designated as the focus target among the plurality of audio contents allocated to each of the plurality of services (S1720) and then output the audio content according to the result of the check (S1730).

The 'getAudioFocus' method can be called to check the audio content to be focused. The 'getAudioFocus' method is to check the currently focused audio content. As a result of the check, the 'HScreen' in the 'org.havi.ui' package. Returns an object of class type. That is, the 'getAudioFocus' method returns a screen representing a service including corresponding audio content, and the output module 960 outputs audio content of the received screen.

18 is a flowchart illustrating a process of outputting audio content according to another embodiment of the present invention.

The output module 960 may simultaneously output a plurality of audio contents. The output module 960 may check the attributes of each of the audio contents assigned to the service (S1810) and output the audio contents set as an output target (S1820).

In this case, the specific audio content set as an output target may be output simultaneously with the focused audio content. For example, assume that audio contents A, B, C, and D are assigned to a plurality of services, and A of which is focused. At this time, if B is set to be impossible to output simultaneously, and C and D are set to be capable of simultaneous output, the output module 960 outputs A, which is the focused audio content, and is set to be capable of simultaneous output at the same time. Will also output.

On the other hand, B which is set to be impossible to output simultaneously may be output when it is focused by a user or an application.

In other words, the output module 960 refers to an output attribute of the audio content assigned to each of the plurality of services and outputs the audio content set as the output target, where the output attribute is set by the user or application to the user / application interface module. Can be set through

The 'addAudioSources' method can be called to set output properties. The 'addAudioSources' method sets whether to simultaneously output each audio content.

Here, the parameters of the 'addAudioSources' method may include a matrix of the 'HScreenDevice []' class type of the 'org.havi.ui' package called 'device' and a boolean flag of 'mixWithAudioFocus'. Here, it is determined whether audio content can be output simultaneously according to the value of the flag.

That is, the user or the application can select at least one or more devices connected to the audio content by using the 'addAudioSources' method and set whether or not to simultaneously output the selected device. For example, 'mixWithAudioFocus' is set to 1 In this case, the audio content of the selected device may be output at the same time as the focused audio content. When the 'mixWithAudioFocus' is set to 0, the audio content of the selected device may not be output simultaneously with the focused audio content. It can be.

In addition, the user or the application may release the audio content for which simultaneous output is set. For this, the 'removeAudioSources' method may be called. Here, the parameter of the 'removeAudioSources' method may include a matrix of the 'HScreenDevice []' class type of the 'org.havi.ui' package called 'device', and at least one set as a parameter as the 'removeAudioSources' method is called. Whether or not simultaneous output of audio content of the above device is possible is released. Meanwhile, the 'removeAudioSources' method may not include a parameter. If the parameter is not included, whether or not to simultaneously output audio contents of all devices is canceled.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

According to the present invention, the service obtained from the cable, satellite, terrestrial broadcasting, various storage media, external input, etc. can be represented in various forms through a physical display screen.

In addition, according to the present invention has the effect of independently selecting and outputting the audio content provided to each service.

1 is an exemplary view showing a form in which a PiP screen is disposed according to an embodiment of the present invention.

2 is an exemplary view showing a relationship between a logic screen and an output screen according to an embodiment of the present invention.

3A to 3E are diagrams illustrating the configuration of a screen including a mapper according to an embodiment of the present invention.

4 is an exemplary diagram illustrating an example of a source for providing a service according to an embodiment of the present invention.

5A and 5B are exemplary diagrams illustrating examples of abstract services and non-abstract services according to an embodiment of the present invention.

6 is an exemplary diagram illustrating attribute information and interface types in a logical screen and an output screen.

7 is an exemplary diagram illustrating a 'z-order' attribute of a logical screen.

8A and 8B are exemplary diagrams illustrating a 'Display_Area' property of a logical screen.

9 is an exemplary diagram illustrating a process in which two services are mapped and output on one output screen.

10 is a block diagram showing the configuration of a multi-screen providing apparatus according to an embodiment of the present invention.

11 is a flowchart illustrating a method of providing a service through multiple screens dynamically configured according to an embodiment of the present invention.

12A and 12B illustrate a PiP service providing mode according to an embodiment of the present invention.

13 is a flowchart illustrating a method of independently selecting and outputting audio content according to an embodiment of the present invention.

14 is an exemplary diagram illustrating a software architecture for providing multiple screens according to an embodiment of the present invention.

15 is an exemplary diagram illustrating a relationship between modules configuring an API layer according to an embodiment of the present invention.

FIG. 16 is a flowchart illustrating a process of displaying a plurality of services on an output screen through a logical screen by each module illustrated in FIG. 15.

17 is a flowchart illustrating a process of outputting audio content according to an embodiment of the present invention.

18 is a flowchart illustrating a process of outputting audio content according to another embodiment of the present invention.

<Explanation of symbols on main parts of the drawings>

900: multi-screen providing device

910: broadcast signal receiving module

920 storage medium

930: external input module

940: Digital Signal Processing Module

950: service processing module

960: output module

965: user / application interface module

970 display screen

980 storage medium

990 external output module

Claims (16)

A service processing module representing a plurality of services; An interface module configured to receive a designation command of a second audio content that is a focus target among first audio contents allocated to each of the plurality of services; And And an output module configured to output the second audio content focused according to the designation command. The method of claim 1, And the output module checks the audio content designated as the second audio content among the first audio content and outputs the audio content according to the verification result. The method of claim 1, And the output module is configured to output specific first audio content simultaneously with the second audio content by referring to attributes of each of the first audio content. The apparatus of claim 1, wherein the second audio content is designated by a user or an application. A service processing module representing a plurality of services; And And an output module configured to output second audio content set as an output target of the first audio content by referring to an output attribute of the first audio content allocated to each of the plurality of services. The method of claim 5, And the output module outputs the focused audio content among the first audio content. The method of claim 6, And the second audio content includes audio content output simultaneously with the focused audio content. The method of claim 5, And an interface module configured to set the output attribute. Representing a plurality of services; Receiving a designation command of a second audio content that is a focus target among first audio contents allocated to each of the plurality of services; And Outputting the focused second audio content according to the designation command. The method of claim 9, And checking the audio content designated as the second audio content among the first audio content. The method of claim 9, The outputting may include simultaneously outputting specific first audio content with the second audio content by referring to the property of each of the first audio content. The method of claim 9, And the second audio content is designated by a user or an application. Representing a plurality of services; Checking an output property of first audio content allocated to each of the plurality of services; And And outputting second audio content set as an output target of the first audio content with reference to the identified output property. The method of claim 13, The outputting of the multi-screen method comprises outputting the focused audio content of the first audio content. The method of claim 14, And the second audio content includes audio content output simultaneously with the focused audio content. The method of claim 13, Setting the output attribute.