KR20080033794A - Method for managing information of an object for presentation of multiple sources and connection group therefor - Google Patents

Abstract

A method of managing information on an object for presentation of multiple sources and a connection group is provided to structure information on items such that presentation for related media components is precisely performed and provide a signal processing procedure between devices according to the structured information. Meta data including protocol information and access position information on an arbitrary content is generated by a control point(290). Protocol information and access position information on a subsidiary content related to the arbitrary content are generated. One of the generated protocol information and access position information and connection information used for acquiring the protocol information and access position information is included in the meta data. Relative information on at least one of at least one component belonging to the arbitrary content and at least one component belonging to the subsidiary content is generated and included in the meta data.

Description

Method for managing information of an object for presentation of multiple sources and connection group therefor}

1A is a configuration diagram of a general UPnP AV network,

FIG. 1B illustrates a signal flow between devices in a media playback process performed in the network of FIG. 1A.

FIG. 2 is an example of networked devices that perform structuring of item information and device-to-device signaling for content with associated supplemental content, in accordance with the present invention;

FIG. 3A illustrates a signal flow between devices according to an embodiment of the present invention for a media playback process of a plurality of components in the network of FIG.

FIG. 3B illustrates a part of signal flow between devices according to another embodiment of the present invention for a media playback process of a plurality of components in the network of FIG.

FIG. 4 schematically illustrates the structure of item information that is constructed including information about auxiliary content presented in cooperation with the corresponding content.

5A and 5B illustrate an example of creating additional expression information of FIG. 4 according to an embodiment of the present invention.

6 and 7 illustrate examples of creating additional expression information of FIG. 4 according to other embodiments of the present invention.

FIG. 8 illustrates an example of creating item information for content that is not presented alone but is presented auxiliary in cooperation with other components.

9A and 9B illustrate user selection screens for multiple components according to an embodiment of the present invention, respectively.

9C illustrates a user selection screen for content having multiple components and a single component, according to an embodiment of the present invention.

FIG. 10A illustrates an example of management information for grouping individual connections that a connection manager service provided in a device establishes. FIG.

FIG. 10B illustrates a conceptual diagram in which temporary IDs for groups and individual connections are organized according to the management information established in FIG. 10A.

11 illustrates a process of querying / controlling any one individual connection in a connection group according to an embodiment of the present invention.

※ Explanation of code for main part of drawing

110,210,290: Control Point 120,220: Media Server

130,230: Media Renderer

The present invention relates to a method for managing information about content sources stored in any device on a network, for example, a UPnP-based network, and processing information between network devices according to the information.

The proposed UPnP ^TM (hereinafter abbreviated as "UPnP") based network for home networking logically consists of a number of UPnP devices, services, and control points (CPs). . In a UPnP network, a service means the smallest small control unit on the network, which is modeled through a state variable.

In a UPnP-based network, control point (CP) refers to a control application with the ability to detect and control other devices and / or services, and any device, for example, a physical device such as a user-friendly PDA. It is operated by.

In the UPnP-based AV home network, as illustrated in FIG. 1A, a media server (MS) 120 providing media data to a home network and a media renderer (MR) for playing media data through a home network are provided. A media renderer (130) and an AV control point (CP) 110 for controlling the media server 120 and the media renderer 130 are configured. The media server 120 and the media renderer 130 are controlled devices controlled by the control point 110.

The media server 120 (exactly, the CDS 121 (ContentDirectory Service) in the server 120) pre-builds the information of the media files and containers (corresponding to the directory) stored therein as object information. Put it. 'Object' is a term used to collectively refer to an item having information about one or more media files and a container having information on a directory. In some cases, an object may be an item or a container as appropriate. . One item may correspond to a plurality of media files. For example, multiple media files with the same content at different bit rates are managed as one item.

FIG. 1B illustrates a brief signal flow between devices for a media playback process performed in the network of FIG. 1A. First, the control point (CP) 110 obtains information about a protocol that can be accepted by the media renderer (MR) 130 (S01). The media server (MS) 120 informs the control point 110 of the directory and the media file under the directory, UPnP action (141), for example browsing according to the user's request Whenever there is a (browsing) action (S10), information about the current directory and item information about media files under the directory are notified.

The CP 110 excludes information on an item that does not conform to an acceptable protocol provided by the media renderer 130 from the information on each received object and displays it through a suitable UI to the user (S11-1). When the user selects one item (or one media file of a certain quality belonging to the item) through the UI (S11-2), the selected media file (hereinafter referred to as a 'component' or 'media component'). Participation elements required for presentation by streaming between the devices 120 and 130 by requesting a connection preparation action (PrepareForConnection ()) to the media server 120 and the media renderer 130 for the presentation of each. Receive a temporary ID (Instance ID) for (CM, AVT, RCS) (S12-1, S12-2). This temporary ID is used to later specify and control the streaming service to be performed (for example, if the SetVolume () action was previously received if you want to adjust the current volume in the rendering of the stream being presented). Use the temporary ID of (S15-1). In addition, the CP 110 transmits the access location information, for example, Universal Resource Locator (URL) information, to the previously selected component through the action of the AVTransport service 133 (in the example of FIG. 1A, the AVTransport service is a media renderer 130). ), But may also be included in the media server 120. After setting to (S13), a play action (play ()) using the temporary ID of the previously received AVT as an input factor is provided to the AVTransport service 133. By requesting (S14), data of the selected component is streamed through the appropriate information exchange process between the media renderer 130 and the media server 120 to be outputted by the RCS 131 (S15).

If one additional media file is to be presented during the presentation (S15), the above-described steps (S11-2, S12-1, S12-2, S13, S14) are performed after the presentation starts. This must be done again. In some cases, S10 and S11-1 may also be performed.

However, the method of sequentially performing the two or more media components may be performed in a case where two or more media components are to be synchronously played back in association with each other. Component '), for example, when one media component is a movie and the other component is a subtitle of the movie, it is difficult to apply. This is because, in the case of sequential playback, synchronous presentation may be difficult or impossible in the media renderer depending on time delay.

An object of the present invention is to structure information about an item and to provide a signal processing procedure between devices according to the structured information so that the presentation of related media components to be presented in cooperation with each other can be made accurately.

Another object according to the present invention is to provide a method for managing individual connections for each component of a multi-component group.

According to an embodiment of the present invention, there is provided a method of creating data about stored content, the method comprising: generating metadata including protocol information and access location information about arbitrary content; Step 2 of generating protocol information and access location information for the auxiliary content associated with the step; including step 3 of including one of the information generated in step 2 and connection information from which the information can be obtained; And generating relation information about at least one component belonging to an arbitrary content and at least one component belonging to the auxiliary content and including it in the metadata.

According to an embodiment of the present invention, there is provided a method of managing a connection between devices, comprising: a step 1 of obtaining a plurality of individual connections, which are currently set, by requesting information about grouped connection groups, and information on the obtained connection groups; In step 2, a single connection group is designated and information about the connection group is requested.

According to another aspect of the present invention, there is provided a method of managing connections between devices, the method comprising: specifying a connection group in which a plurality of individual connections are grouped and requesting and obtaining information on the connection group; and obtaining the obtained connection group In step 2 of specifying one individual connection from the information of the request and obtaining information about the individual connection, and obtaining the identification information assigned for one service from the obtained individual connection information by using the identification information This involves three steps of invoking the action.

According to the present invention, a method of presenting content through data transmission between both devices includes at least one auxiliary associated with the main component with respect to a selected main component belonging to the main component or a plurality of main components belonging to the content. If there is a component, step 1 of generating connection group information and connection information for each component, and for each of the generated connection information, the generated information together with information indicating whether the connection information is for a primary / secondary component And two steps of associating with the connection group information.

According to an embodiment of the present invention, a method of providing a user with information about a content object stored in a device includes: step 1 of displaying result information of inquiring of the content objects stored in the device; and included in the result information. If the information on the object selected from the existing objects includes information on the relationship with the auxiliary components that should be presented auxiliary in synchronization with other content, the component belonging to the selected object based on the information on the relationship and And providing a screen for selecting the auxiliary components.

According to an embodiment of the present invention, the relationship information may include a combination capable of interworking presentation of a component belonging to at least one component belonging to the arbitrary content and a component belonging to at least one component belonging to the auxiliary content. Contains component set information that can be obtained, and type information about the relationship.

In one embodiment according to the present invention, the relationship information includes a name representing the relationship and display information to help a user select a component from the component set information.

According to an embodiment of the present invention, the secondary content related element structure in the metadata may include a component package so that a plurality of components to be interworked with one main component belonging to the main content are accommodated. Has a structure.

In one embodiment according to the invention, the access location information is a Universal Resource Locator (URL).

In one embodiment according to the present invention, the connection management service in both devices calls a connection preparation action for each component to receive an ID for each connection, and for each connection ID, an action for subscribing to connection group information. Call the connection management service in both devices.

According to an embodiment of the present invention, when linking individual connection information to the generated connection group information, if the individual connection is for an auxiliary component, information indicating the attribute of the auxiliary component is also included in the association information. .

In one embodiment according to the present invention, after calling the group connection preparation action for a connection group, the connection preparation action for each connection is called for each component.

In another embodiment according to the present invention, the connection preparation action for each connection is called for each component, and then the group connection preparation action for the connection group is called.

In an embodiment of the present invention, an action of acquiring temporary IDs for all individual connections by invoking a connection preparation action for individual connections for all components required for content play, and then joining each temporary ID to a connection group. Perform.

In another embodiment according to the present invention, if any one of all components required for content play is obtained, a temporary ID for a corresponding individual connection is obtained, regardless of whether a temporary ID for another individual connection is obtained. Perform the action of joining a connection group.

In one embodiment according to the present invention, as information about one connection group, information about the type of connection group, identification information of each individual connection belonging to the connection group, and whether the information is about the primary or auxiliary component of each individual connection. And optionally include information indicative of attributes for the component if the individual connection is for a secondary component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a simplified example of networked devices that perform the structure of item information and device-to-device signal processing for a component having an associated component according to the present invention. The network of FIG. 2 is a UPnP-based AV network and includes a control point 210, a media server 220, and a media renderer 230. In the description of the present invention, networked devices based on the UPnP standard will be described. However, the following description can be applied to other network standards by adaptively replacing necessary elements according to the difference of the standard. Is not dependent on UPnP-based networks.

According to the present invention, the structure of the item information for the multi-component is performed by the CDS 221 in the media server 220, the signal processing for the multi-component according to the present invention is an example, the control point 210 Based on, it is performed according to the process illustrated in FIG. 3A.

On the other hand, the configuration and signal processing of the device illustrated in Figs. 2 and 3 is shown for the pull method in two ways of streaming media components, that is, push mode and pull method. However, the difference between the push and pull method is that the device with the AVTransport service for streaming playback management or the device used is different, and accordingly, the direction of the action is different depending on whether the action is a media server or a media renderer. Since the method of performing the action described below is the same in the push and pull method, the interpretation of the claims of the present invention is not limited to the method illustrated in the drawings and the description.

The CDS 221 (which may be one processor running software) in the media server 220 may search for media files stored in a large amount of storage such as a hard disk. Item information about components, that is, meta data about each component or a group of components, is written in a specific language. In this case, one item information is generated for the media files related to the interworking presentation as one content. 4 shows the structure of the item information generated by this method. That is, as shown, the resource element (<resource>) as in the prior art for the main component (for example, AV stream) or the main components of each component considered to belong to one item is selected. In addition to the item property information 401 that is included, information about auxiliary components (for example, subtitles, voice, etc.) or auxiliary components among each component, and a component set for selecting various combinations of user experience is specified. Additional presentation information 402 is further created for relationship information.

The CDS 221 recognizes the correlation between each media file and whether it is a main component or an auxiliary component, for example, from the name and / or extension of each file. And / or information about what is coded may also be obtained from the extension of the file. In addition, if necessary, the corresponding file may be opened to be grasped from the header information in the file, and previously written (by another application program, etc.) for the recorded media files (or files included in a removable recording medium provided separately). The above information can be easily obtained from the db stored in the same medium for the files.

5A and 5B show an example of preparing the additional expression information 402 according to an embodiment of the present invention. According to the illustrated embodiment of FIG. 5A, the element <userExperienceExpression> for the additional presentation information 402 is composed of, for example, three parts. The first part 510 is a resource element (<primary resource>) for the main component, and is an element for assigning an ID to the main component or the main components included in the resource element in the item property information 401. In the example of FIG. 5A, IDs 1 to n are assigned to n primary components, respectively (511).

The second part 520 is a resource element (<additional resource>) for the auxiliary component, which assigns IDs to auxiliary components presented in association with the primary component and records protocol and location information for access. . In the example of FIG. 5A, IDs of n + 1, n + 2, m + 1, and m + 2 are allocated to four auxiliary component packages (521). The reason for assigning ID to a package having at least one component without assigning one ID for each auxiliary component is that there are components that can be normally presented when a plurality of components (media files) are combined. In the example of FIG. 5A, the files of Terminator.sub and Terminator.idx include image information for displaying captions in the former, and caption images in Terminator.sub in AV data (for example, Terminator.mpeg) of the main component. Since the timing information for synchronous output is stored, the components of both files are allocated to one component package and one identifier (n + 1) is allocated (522).

The third part 530 is a set of relational elements that specify component set information for obtaining a combination of presentations (i.e., experienceable by the user) for which the primary component and the secondary component can be presented together. An example is shown. As shown, the third portion 530 defines a set of components from which possible presentation combinations of components assigned identifiers in the first portion 510 and the second portion 520 can be obtained. In the example of FIG. 5B, three (531, 532, 533) relations defining a set of components that can obtain a presentable combination for the current item are created, and an element (<relationship>) 531 that designates the first relation Is the primary component set 1 and 2, the secondary component set is n + 1, n + 2, showing four possible combinations, and the element 532 that specifies the second relationship has the primary component set n- 1 and n, the secondary component set is n + 1, n + 2, and another secondary component set is m + 1, m + 2, and the element 533 that specifies the third relationship is the primary component set. Are 1 and 2, and the auxiliary component set is n + 3, n + 4. When one relationship is selected, one component in each component set may be selected and interworked to be presented.

Referring to the relationship creation example illustrated in FIG. 5B in more detail, n + 1 and n + 2 are designated as subcomponents for subtitle information that can be presented by interworking with each of the main components 1 and 2 ( 531a) (i.e. the interworking presentation combination is one of (p, a) = (1, n + 1), (1, n + 2), (2, n + 1), (2, n + 2) ), If the subcomponents n + 1 and n + 2 and the subcomponents for the subtitle information that can be presented in cooperation with each of the main components n-1 and n are voices, the subcomponents m + 1 and m. +2 is specified (532a). The example of FIG. 5B is based on the premise that the main components n-1 and n do not contain an audio signal, and the CDS 221 communicates a speech signal (in case of a movie) for the corresponding main components n-1, n. Subcomponents m + 1 and m + 2 are included in the presentation combination. In addition, as in the example of the second relational element 532, a plurality of auxiliary components having different attributes may be associated with the primary component. Therefore, to distinguish this, add an order parameter to an element (<additionalComponent>) that specifies an auxiliary component and specify a level value for the parameter to separate the attributes. In the example of FIG. 5B, the order parameter is set to 0 for the auxiliary component of the caption information and is set to 1 for the auxiliary component of the audio information. In addition, in order for the user to easily recognize the relationship information and use it as help information for selection, the CDS 221 may include a name, a usage, and an auxiliary component corresponding to the corresponding relationship element. Write information about each element (<name>, <usage>, <subtitleLang>, <voice>) indicating attribute information. The information thus created is presented to the user through the appropriate UI by the CP 210, which receives and interprets metadata about the object, so that the main and auxiliary components for the presentation can be selected.

The CDS 221 also specifies a type element (<type>) in each relational element. For each of the type elements, the CDS 221 is designated in advance in the CDS 221. In addition, the method of creating the aggregate information of the combination of the components for each type is also specified in advance in the CDS 221 as a policy. Referring to the example of FIG. 5B, for 'TTO' which designates the type of subtitle information synchronized with time, a set of a main component and an auxiliary component having subtitle information is specified, and subtitle information and audio information are simultaneously specified. For 'TTO_VOICE', a set of a main component, an auxiliary component having subtitle information, and an auxiliary component having voice information is designated. In addition, various types can be defined and used. For example, a slide show can be a type. In addition, for a component that makes presentations that support the main component, a type can be designated by specifying a distinguishing name accordingly. Accordingly, the present invention is not limited to the type of subtitles used for the relationship element, and the subtitles and voices.

Information of the item created as illustrated in FIGS. 4 and 5A and 5B is transmitted from the CDS 221 to the CP 210 in response to a browsing action or a search action, and interpreted. The interpretation will provide the user with information for selection as appropriate. This will be described later.

The embodiment of FIG. 5A is created by inserting protocol information (“protocolInfo”) for an auxiliary component and location information for accessing the component, for example, URL information, into item information of directly related content. However, in another embodiment of the present invention, indirect information may be recorded so that the information may be identified instead of protocol and URL information about the auxiliary component related to the main component. This indirect information can be, for example, the ID of an object assigned to the associated auxiliary component. FIG. 6 shows additional expression information created according to the present embodiment under the same conditions as in FIG. 5A. As illustrated in FIG. 6, an object ID for the corresponding auxiliary component is created instead of protocol and URL information for the component (541).

For the embodiment of FIG. 6, the CDS 221 is a component that is not presented alone but is presented to another component in a process of identifying the stored media files and its storage tree structure (which is described above. As mentioned above, it is confirmed by the extension of the file, etc.) is also configured as an object, and item information for each object is created in the form as illustrated in FIG. However, since these objects need to be managed differently from objects of a component that can be presented alone, they are designated as a separate type 601, for example, object.item.TTOItem. In the example of FIG. 8, as mentioned in the description of FIG. 5A, for a group of auxiliary components that are not capable of normal presentation alone (or become meaningless presentations) and whose normal presentation is possible only by mutual information. Item information is created by assigning to one object. The item information created in FIG. 8 is linked to the indirect information 542 of the auxiliary component on the additional presentation information created in FIG. 6 by the object ID, that is, obj1234 602.

In another embodiment according to the present invention, the protocol information of the auxiliary component and the information on the URL of the component are used by mixing the direct information writing method of FIG. 5A and the indirect information writing method of FIG. 7 shows an example of the additional expression information created accordingly. As shown, the protocol information and URL information for the additional component are directly written or the object ID for the auxiliary component (or auxiliary component package) is written. Of course, the components for recording the object ID should be assigned as an object as illustrated in FIG. 8 and item information for the object should be created. As in the present embodiment, since information on the auxiliary component may be recorded by mixing each other directly or indirectly, it may be recorded in a resource element (<additionalComponentRes>) for the auxiliary component so that the CP 210 can be easily divided. By additionally inputting information about the type of the source representation type, that is, direct or indirect (551), the CP 210 which interprets metadata about the object can easily grasp protocol information and URL information about the auxiliary component. To be. After the item information for the stored files is constructed according to the above-described method or one of the above-described methods, as shown in FIG. 3A, the information about each item is displayed in a browsing action or search of the CP 210. The action is transmitted from the CDS 221 to the CP 210 (S31). Of course, as shown in FIG. 3A before the action, the CP 210 requests and obtains protocol information acceptable to the media renderer 230 (S30).

The CP 210 provides only the objects (items) having the protocol information acceptable to the media renderer 230 to the user through an appropriate UI (User Interface) in the information of the objects received in step S31 (S32-1). ). At this time, if there is an item of the type "object.item.TTOItem" as shown in Fig. 8, the item is not presented to the user. In another embodiment according to the present invention, an item whose type is "object.item.TTOItem" may be displayed to the user in lighter color than other types of items so as to be distinguished from each other.

Meanwhile, the user selects an item to be presented to the media renderer 230 (or one of a plurality of components having different bit rates belonging to the item) from the provided list of objects (S32-2). However, if additional expression information (information corresponding to the <userExperienceExpression> element in FIGS. 5A and 5B and 6 and 7) exists in the metadata of the selected item, an action for presentation on the component of the selected item is immediately performed. Instead, the additional expression information is interpreted as follows to perform the additional selection operation accordingly (S32-3).

The CP 210 first identifies the elements of the <relationship> that describe the relationship to the presentable combination in the metadata of the selected item. In relational elements, the ID of the currently selected component (this ID can be found in the primary component's <primary resource> in the supplementary presentation information) is not specified in the <primaryComponent> element. Actions for playback (PreparedForConnection (), SetAVTransportURI (), Play (), etc.) are immediately requested in sequence, and if described, a selection list based on the information created in the relevant relationship element is additionally presented to the user. FIG. 9A is an indication of this and is written for the first relational element 531 of FIG. 5B. FIG. 9A shows an example in which a component having ID 1 is selected as the main component, so that components (or component packages) of ID n + 1 and n + 2, which are auxiliary components of subtitles associated with the subtitles, are listed 701 for selection. . For the purpose of describing an embodiment of the present invention, it is assumed that one main component has been selected above, and therefore, when displaying information on a relational element, the main component (shown in the main component set included in the relational element) is shown. In the illustrated example, a separate indication 701 may be made for the main component 1) to indicate that it has already been selected. And, a selection bar for selecting a component is located in the auxiliary component set. In the example of FIG. 9A, each component is classified by ID of a component for convenience, but information displayed to an actual user may include a file name or an object title corresponding to the component (as shown in FIG. 8. Case).

If the selected main component belongs to a plurality of relational elements, as shown in FIG. 9B, additional information is written in the names and internal elements of each relational element (in the example of FIG. 9B, designation information of the <subtitleLang> element). To select one relationship element from the window, and present one selection screen as shown in FIG. 9A when one relationship element is selected in the window. do. In the display example of FIG. 9B, when an item of 'subtitle (Korean)' is selected, the CP 210 outputs a selection screen as shown in FIG. 9A. Of course, the CP 210 knows from the type element (<type>) described in each relationship element which auxiliary element set of the attribute is included in the relationship element. It may further present the explanatory information that can be easily recognized.

In another embodiment according to the present invention, when a user selects an item to present to the media renderer 230 from a list of provided objects, the user may select one of the plurality of main components belonging to the item. Instead of presenting the selection screen such as 9a or 9b, if the item is selected, additional expression information of the corresponding metadata is analyzed to provide the selection screen as shown in FIG. 9c. In the selection screen illustrated in FIG. 9C, one item presented in the multiple component window corresponds to one relationship element. Therefore, when one item belonging to the multi-component window is selected in the selection screen provided by the user, the selection screen as shown in FIG. 9A is presented based on the information of the relational element corresponding to the item to display one main component and at least one auxiliary component. When a component is selected and an item belonging to a single component window is selected, necessary actions are called to related devices so that a component corresponding to the item is played directly on the media renderer 230.

According to the above-described process, when the selection of the primary component and the secondary component is finished, the CP 210 obtains protocol information and URL information about the selected component from related elements, i.e., the conventional scheme for the primary component. The auxiliary component is obtained from the <additional resource> element described above for the auxiliary component. 6 and 7, when information on a corresponding component is designated in an indirect manner, the CP 210 acquires corresponding protocol information and URL information using the indirect information, that is, the object ID as index information. . For example, if the metadata of the corresponding object ID is received by the previous browsing operation, the CDS includes a search action written in the metadata, and if not received, information including the object ID as an input argument. By requesting 221, desired protocol information and URL information are obtained from the corresponding element (<additionalComponent> element in the example of FIG. 8) created in the received metadata.

If the protocol information of the auxiliary component obtained in the above process does not conform to the acceptable protocol of the media renderer 230 obtained previously, the auxiliary component is ignored and the presentation is performed by the media renderer 230. Do not perform the operation described below. Instead, the secondary component selected for the user may output a notification message such that it cannot be rendered in the media renderer!

The following connection preparation operation is performed on the main component and the auxiliary component from which the protocol information and the URL information are obtained. Connection preparation actions are performed for each connection group and individual connection. That is, as illustrated in FIG. 3A, the group connection preparation action (PrepareGroupConnection ()) for the connection group is called to the CM service 222 and 232 of each device (the media server 220 and the media renderer 230) ( S33-1, S33-2). In this group connection preparation action, the type information in the selected relational element is passed as an input argument. The side receiving the type information can predict in advance the number of individual connections forming the connection group through the type information. In the above example, when the type is 'TTO', it can be seen that a separate connection for providing a subtitle and a separate connection for a main component will form a corresponding connection group. After the group connection preparation action is called, a connection preparation action (PrepareForConnection ()) for an individual connection for each component is requested to the media server 220 and the media renderer 230 separately, that is, for each component. Receive temporary IDs (Instance IDs) for participating services required for presentation by streaming (S34-1, S34-2). The example of the signal processing flow of FIG. 3A is an example in which two auxiliary components (or one auxiliary component package) are associated with one main component, and three identical actions between devices in the case of an action performed on an individual connection. (Of course, the input argument to the action has been written for each component and therefore has different information.) Shows that it is called.

The temporary ID of each participating service (CM, AVT, or RCS) for each connection of each component by the connection preparation action (this temporary ID is referred to as a set of IDs assigned for each service or a temporary ID for convenience). In the following description, when there is no formula of an individual service, the temporary ID means a set of temporary IDs for each service allocated to one connection. To group the temporary IDs for the connections, add a group join action (AddtoGroup ()) to associate the temporary IDs for each individual connection with the temporary IDs for the group connections received by the group connection preparation action. Request as many (S35-1, S35-2). In this case, input parameters of each group join action include a temporary ID for a connection group, a temporary ID for one individual connection to be included in the connection group, and whether a component corresponding to the individual connection is a main component or a secondary component. Information (primary / optional), in the case of an auxiliary component, information indicating the attribute (this information is information of the order parameter in the <additionalComponent> element in the relation element, as illustrated in FIG. 5B). .

In the above description of the embodiment, after the group connection preparation action for the connection group is called (S33-1, S33-2), the connection preparation action for the individual connection is called for each component (S34-1, S34-2). However, the calling order of this action may be reversed. In other words, before performing the group join action described above, the group ready preparation action and the connection preparation action for the individual connection are performed regardless of the order, thereby making a temporary ID for the individual connection to be joined to the group and a temporary ID for the connection group. What is necessary is just to provide.

Upon receiving the action for the temporary ID connection, the CM service 222 or 232 provides management information for mapping the temporary ID for the connection group included in each group subscription action and the temporary ID for the individual connection. Build. FIG. 10A illustrates an example of management information for grouping individual connections, established by the ConnectionManager service 232 in the media renderer 230 (the media renderer 230 of FIG. 2 includes an AVTransport service 233). Since the temporary ID for the AVTransport service is also provided as a response in response to the connection preparation action, the temporary ID for the connection also includes the temporary ID of the AVTransport service.), FIG. The temporary IDs illustrate the structured conceptual diagram. Meanwhile, in addition to the mapping information for the temporary ID illustrated in FIG. 10A, information received by the input factors of the group connection preparation action and the group join action, for example, the type, whether the primary / secondary component of the individual connection, and the order parameter of the secondary component are included. Information and the like are also stored and managed by the CM service 222 or 232 as management information.

By constructing the mapping information as shown in Fig. 10A, each ConnectionManager service 222, 232 sends a service request for action control to playback management or rendering control from the CP 210 by a temporary ID of a subsequent connection group. By identifying the temporary IDs of the individual connections, the corresponding resources can be specified.

On the other hand, in the above-described embodiment, the CP 210, as illustrated in Figure 3b, before receiving all the temporary IDs for each connection as needed by the individual connection preparation action for the selected components, When a temporary ID is received by one action, an action (AddtoGroup ()) may be performed to join the connection to the connection group previously set by the group connection preparation action. 3B is for showing that the group join action is requested immediately upon response to the connect preparation action, and does not necessarily indicate that the connect preparation action for the next connection must be sequentially performed after one group join action. In the embodiment of FIG. 3B, the execution of the group join action AddtoGroup () may be performed regardless of whether the response of the connection preparation action (PrepareForConnection ()) of another connection is received.

After grouping individual connections by the above-described operation, an action (SetAVTransportURI ()) for setting the access location information, for example, URL information, for the component to the AVTransport service 233 for each component selected above is performed. Call individually (S36). The playback action is called to the AVTransport service 233, where the temporary ID for the previously received connection group is used for the action (S37). The temporary ID for the connection group of this action is mapped to the temporary ID for the individual connection by the ConnectionManager service 232 and transmitted to the AVTransport service 233 so that the playback operation for each individual connection can be started at the same time. Accordingly, through the appropriate information exchange process between the media renderer 230 and the media server 220, the data of each selected component is all streamed or downloaded, and under the control of the RenderingControl service 231, each corresponding decoder (or integrated) The decoder is interworked with each other and decoded (S38).

In the above description of the embodiment, the action of setting the URL of each component (SetAVTransportURI ()) is called after the group join action, but the order of these actions is only one example, and the action of setting the URL is the group join action. It may be called before (AddtoGroup ()). In other words, the order of both is not constrained.

On the other hand, while the presentation operation is being performed according to the above procedure (S38), the request or rendering for the control of the specific reproduction operation (playback stop, temporary stop, search, shift play, etc.) is performed. When there is a request for a status change (volume control, audio output stop, brightness control, etc.) from the user, the CP 210 may perform an action (eg, AVT: Stop (), AVT: Pause (), RCS) accordingly. When requesting: SetVolume (), RCS: SetMute (), etc.) to the media renderer 230, a temporary ID for a connection group allocated to streaming of multiple components currently being serviced is used. When a temporary ID for a connection group is used, one individual connection may be specified by translating the temporary ID of the individual connection corresponding to the action on the service side receiving the action. Alternatively, a temporary ID for an individual connection in a connection group may be obtained and used when requesting an action, which will be described below.

By grouping the individual connections by the above-described process and delivering the necessary information to the related service through the action, the grouped individual connections through the CP 210 that created the connection group or another CP newly participating in the network. One of the desired connection can be selected to perform information inquiry or control of the connection.

FIG. 11 illustrates an example of this, and according to another embodiment of the present invention, a process of querying information related to play of media content corresponding to a specific individual connection belonging to a connection group is provided. 11 illustrates an action call with the media renderer 230 as an example, but may also be applied to an action call with another device, for example, the media server 220. As shown, the CP 290 of FIG. 11 recalls an action (GetGroupConnectionIDs ()) for inquiring connection groups currently set for the device specified by the user, the media renderer 230 in the example of FIG. Call the CM service 232 in the media renderer 230. Accordingly, temporary IDs (instance_GrCMIDs) of the CM service for the currently established connection groups are received (S1101).

The CP 290 selects one connection group from the received information. At this time, the condition necessary to select one connection group is determined according to the information input from the user. When one connection group is selected, a connection group information inquiry action (GetGroupConnectionInfo ()) that uses a temporary ID (instance_GrCMID) of the CM service for the connection group as an input argument is called to the CM service 232. In response to this call, the CM service 232, based on the management information currently managed for the connection group, determines the type of connection group specified by the input argument of the action (i.e., the relation element that forms the connection group). type), and the CM service temporary ID of all individual connections belonging to the connection group, the primary or auxiliary (primary / optional) of the component of the connection, and the value of the order parameter in the case of the auxiliary component. In response to the call is delivered to the CP (290) (S1102).

The CP 290 selects one individual connection from the received information. The conditions necessary to select one individual connection are determined based on the information entered from the user. For example, when the user requests the inquiry of track information or playing time of the main component currently playing, the user selects an individual connection designated as 'primary', and wants to change the subtitle or audio language of the playing content. In this case, it is set as 'optional' and the order parameter selects an individual connection according to the property. When an individual connection is selected, a current connection information inquiry action GetCurrentConnectionInfo () is called to the CM service 232 using the CM service temporary ID (instance_CMID) for the individual connection as an input argument. According to this call, information on the individual connection (temporary ID of another service, protocol information, etc., as illustrated in FIG. 11) is received (S1103).

The CP 290 uses the received information to determine an appropriate action target service and an action type corresponding to a user request, and call the determined action on the determined service. In the example of FIG. 11, the media information is requested from the AVTransport service 233, which is an action for the AVTransport service 233, and thus, instance_AVTID, which is a temporary ID of the AVTransport service, is used as an input argument of the action in the previously received information. According to this action, the AVTransport service 233 transfers the various state information as illustrated in FIG. 11, which is managed by the AVTransport service 233 to the requested CP 290 (S1104).

The state in which the connection group is established is released by the request of the CPs 210 and 290 when there is a request from the user or when it is determined that no further streaming of multiple components is required. In this case, the CPs 210 and 290 request the connection manager service 222 and 232 to remove the group (RemoveFromGroup ()) from the group for each individual connection to be released. The action will include a temporary ID for the connection group and a temporary ID for the individual connection to be removed from the connection group. Accordingly, the ConnectionManager service 222 or 232 that has received the action, in the ID mapping information created as shown in FIG. 10A, of the received action connected to the temporary ID for the connection group in the input argument of the received action. Delete the temporary ID, such as the temporary ID for each connection in the input argument. Each time a group withdrawal action deletes a temporary ID for an individual connection from the ID mapping information, the CM service 222, 232 checks the mapping information of the temporary ID for that connection group and the remaining individual connections associated with it. If there is no temporary ID for the connection, the temporary ID for the connection group of the mapping information is deallocated so that it can be reused as the temporary ID for the other connection group.

Or more, preferred embodiments of the present invention described above, for the purpose of illustration, those skilled in the art, within the technical spirit and the technical scope of the present invention disclosed in the appended claims below, to further improve various other embodiments Changes, substitutions or additions will be possible.

The present invention described as a limited embodiment of the present invention, in a situation in which data is transmitted and presented between devices interconnected via a network, has one main component with a secondary component associated therewith, Simultaneous playback allows media components to play back normally, and also allows individual connections within a connection group to be managed separately. Accordingly, the user can increase the satisfaction of viewing or listening to the content by the auxiliary component and improves user convenience in changing some components during reproduction of multiple components.

Claims (18)

In the method for creating data about the stored content, Generating metadata including protocol information and access location information for arbitrary content; Generating protocol information and access location information for auxiliary content associated with the arbitrary content; Incorporating one of the information generated in the second step and connection information for acquiring the information into the metadata; And generating relationship information about at least one component belonging to the arbitrary content and at least one component belonging to the supplemental content and including it in the metadata. The method of claim 1, The connection information is an object ID assigned to the auxiliary content. The method of claim 2, The second step is to generate the metadata for the auxiliary content and to include the protocol information and access location information for the generated auxiliary content in the metadata. The method of claim 2, The metadata generated for the supplemental content includes type information specifying that the content is content to be presented in synchronization with other content. The method of claim 1, The relationship information includes component set information for obtaining a mutually interoperable presentation of a component belonging to at least one component belonging to the arbitrary content and a component belonging to at least one component belonging to the auxiliary content. How it is. The method of claim 5, The relationship information includes a name representative of the relationship and display information to help a user select a component in the component set information. The method of claim 1, Wherein the relationship information includes type information about the relationship. The method of claim 7, wherein The type of the type information includes subtitles and subtitles and audio. In the method of managing the connection between devices, A first step of designating a connection group in which a plurality of individual connections are grouped and requesting and obtaining information on the connection group; Step 2 of designating one individual connection from the obtained connection group information and requesting and obtaining information on the individual connection; Obtaining identification information allocated for one service from the obtained individual connection information and calling an action using the identification information. The method of claim 9, And the information obtained in step 1 includes identification information of each individual connection belonging to the designated connection group and information on whether the connection is for the primary or secondary component of each connection. The method of claim 10, And wherein the information obtained in step 1 further comprises information indicative of a property of the component when the connection is for an auxiliary component. The method of claim 9, The information obtained in step 1 further comprises type information for the designated connection group. In the method of presenting content through data transmission between both devices, Generating connection group information and connection information for each component if there is at least one auxiliary component associated with the main component with respect to a main component belonging to the content or a selected main component among a plurality of main components; For each of the generated connection information, associating the generated connection group information with information indicating whether the connection information is for a primary / secondary component. The method of claim 13, The second step is to associate information indicative of the property of the component with the generated connection group information when the connection is for the auxiliary component. The method of claim 13, The first step is to specify the type of connection group to generate the connection group information. In the method of managing the connection between devices, A first step in which a plurality of individual connections, which are currently set, request and obtain information about grouped connection groups, and And designating one connection group from the obtained connection group information and requesting and obtaining information on the connection group. The method of claim 16, The steps 1 and 2 are for requesting information about a service managing a connection implemented in a device and obtaining from the service. In the method for providing a user with information about a content object contained in the device, Step 1 of displaying the result information of inquiring about the content objects stored in the device; If the information on the object selected from the objects included in the result information includes information on the relationship with the auxiliary components to be presented auxiliary in synchronization with other content, based on the information on the relationship, And providing a screen for selecting the components belonging to the selected object and the auxiliary components.

Images