WO2012169780A2

WO2012169780A2 - Control apparatus, control target apparatus, and method for converting content thereof

Info

Publication number: WO2012169780A2
Application number: PCT/KR2012/004467
Authority: WO
Inventors: 양승률; 전범진; 박장웅
Original assignee: 엘지전자 주식회사
Priority date: 2011-06-07
Filing date: 2012-06-07
Publication date: 2012-12-13
Also published as: WO2012169780A3

Abstract

A method for operating a control apparatus according to one embodiment of the present invention, in which the control apparatus includes a method for providing a content-converting service using a control target apparatus, comprises the steps of: searching for control target apparatuses connected to a home network; selecting any one from among contents contained in a server apparatus on the basis of content information received from at least one server apparatus among the searched apparatuses; determining, on the basis of protocol information received from at least one renderer among the searched apparatuses and said content information, whether or not the selected content can be reproduced by the renderer; and, if the selected content cannot be reproduced, making a request for the start of conversion of the selected content to any one apparatus among the searched apparatuses.

Description

Control device, control target device and their content conversion method

The present invention relates to a control device, a control target device and a content conversion method, and more particularly, to a method of operating a control device and a control target device for providing a content conversion service and a reproduction service accordingly.

Universal plug and play (UPnP) technology and digital living network alliance (DLNA) technology enable service and control between consumer electronics devices from a variety of manufacturers. In particular, UPnP technology and DLNA technology enable compatible AV services and controls between audio-visual (AV) devices. These compatible AV services include media streaming, uploading and downloading.

UPnP is a home network device that is a digital media server (DMS), digital media player (DMP), digital media renderer (DMR), digital media controller (DMC) and It defines digital media printer (DMPr), mobile digital media server (M-DMS), mobile digital media player (M-DMP), mobile digital A media uploader (M-DMU), a mobile digital media downloader (M-DMD), and a mobile digital media controller (M-DMC) are defined.

Hereinafter, the digital media server (DMS) is used to cover the M-DMS, the digital media player (DMP) is used to cover the M-DMP, and the digital media controller (DMC) covers the M-DMC. Use it as a concept.

Such devices may be classified into control point (CP) devices and control target devices. The digital media controller (DMC) and the digital media player (DMP) may be classified as control point devices, and the digital media renderer (DMR), digital media server (DMS), and DMPr may be classified as control target devices.

Meanwhile, DLNA defines a 2 Box Model and a 3 Box Model.

The two box model includes a digital media player (DMP) and a digital media server (DMS). In the two box model, a digital media player (DMP) allows a user to find and play content that has been advertised and distributed by a digital media server (DMS).

The three box model includes a digital media controller (DMC), a digital media server (DMS), and a digital media renderer (DMR). In the three box model, the digital media controller (DMC) allows the user to find the content of the digital media server (DMS) to be played on the digital media player (DMP).

Devices that comply with UPnP and DLNA send and receive commands via Internet protocol networking (IP Networking). That is, one of the AV devices connected to the same network may provide an AV service to another device, may receive an AV service from another device, control another device, or may be controlled from another device. .

Such an AV service may include a streaming service for streaming AV content from a digital media server to a digital media renderer. In addition, the digital media renderer can play the streamed AV content. The control point controls the digital media server and the digital media renderer such that the user can play the specific AV content of the desired digital media server on the specific digital media renderer.

However, since the types of AV content that can be played in the digital media renderer are limited, there is a problem that the AV content that is streamed from the digital media server cannot be played. In addition, there is a problem that AV content streaming may be interrupted due to the degradation of the home network environment during playback.

An object of the present invention is to provide a control device, a control target device and a method of operating the same, when the content to be streamed cannot be reproduced by the control target device, which can be converted and streamed to be playable.

Another object of the present invention is to provide a control device, a control target device, and a method of operating the same, which efficiently convert and store content and stream content using network resources.

Another object of the present invention is to provide a control device, a control target device, and an operation method thereof, which can be converted in advance even when there is no user request.

A method of operating a control device according to an embodiment of the present invention includes a method of providing a content conversion service by a control device using a control target device, the method comprising: searching for control target devices connected to a home network; Selecting one of contents included in the server apparatus based on content information received from at least one server apparatus among the discovered apparatuses; Determining whether the renderer can play the selected content based on protocol information received from at least one renderer of the discovered devices and the content information; And if it cannot be reproduced, requesting one of the discovered devices to start conversion for the selected content.

According to another aspect of the present invention, there is provided a method of operating a control target device, the method comprising: transmitting at least one of content information and stored information to the virtual server device according to a request of the virtual server device; ; Transmitting conversion capability information to the virtual conversion device according to a request of the virtual conversion device; Receiving a conversion start request message from the virtual conversion device; And converting a profile of specific content on a network based on the conversion start request message.

According to another embodiment of the present invention, a control device includes: a communication module for searching for control target devices connected to a home network, and performing communication with the found control target devices; And selecting one of contents included in the server apparatus based on content information received from at least one server apparatus among the discovered apparatuses, and a protocol received from a renderer to play the content among the discovered apparatuses. A control unit for determining whether the renderer can play the selected content based on the information and the content information, and if it is impossible to play, requesting one of the searched devices to start conversion of the selected content through the communication module; It includes.

The control target device according to another embodiment of the present invention transmits at least one of content information and storage information to the virtual server device according to a request of the virtual server device, and transmits the conversion capability information according to the request of the virtual conversion device. A communication module for transmitting to the conversion device; And a control unit for converting a profile of a specific content on a network based on the conversion start request message when receiving a conversion start request message from the virtual conversion device through the communication module, wherein the control unit is a playback device connected to the network. Stream the converted content through the communication module in response to a streaming request from.

The control device and the control target device according to an embodiment of the present invention can convert and stream the content that cannot be converted in the playback device.

The control device and the control target device according to an embodiment of the present invention can reduce the load of network resources by efficiently utilizing network resources during conversion.

The server device according to another embodiment of the present invention may perform the conversion in advance to improve user convenience.

1 is a diagram schematically illustrating a home network including a control device and a control target device according to an exemplary embodiment of the present invention.

2 is a ladder diagram illustrating a content conversion method according to an embodiment of the present invention.

3 is a ladder diagram for describing a content conversion method according to another embodiment of the present invention.

4 is a ladder diagram for explaining a process of collecting transformation capability information by a virtual transformation apparatus according to an exemplary embodiment of the present invention.

5 is a ladder diagram for explaining a process of collecting storage information by a virtual storage device according to an exemplary embodiment of the present invention.

6 is a ladder diagram for explaining a process of collecting playback capability information by a virtual playback apparatus according to an exemplary embodiment of the present invention.

FIG. 7 is a ladder diagram for explaining a process of converting content without storage by a control device and a control target device according to another embodiment of the present invention.

FIG. 8 is a ladder diagram for describing a method of converting content between a control device and a control target device when alternative storage is selected according to another embodiment of the present invention.

9 to 14 are ladder diagrams for describing various examples of content conversion methods of a control device and a control target device when storage is selected according to another embodiment of the present invention.

15 to 18 are ladder diagrams for describing content conversion methods of a control device and a control target device which perform conversion in advance according to another embodiment of the present invention.

19 is a flowchart illustrating a method of operating a virtual conversion apparatus according to an embodiment of the present invention.

20 to 25 are diagrams illustrating a user interface output according to a content conversion method according to an embodiment of the present invention.

FIG. 26 is a block diagram illustrating a configuration of a control device or a control target device according to an embodiment of the present invention. FIG.

The following merely illustrates the principles of the invention. Therefore, those skilled in the art, although not explicitly described or illustrated herein, can embody the principles of the present invention and invent various devices that fall within the spirit and scope of the present invention. In addition, all conditional terms and embodiments listed herein are in principle clearly intended for the purpose of understanding the concept of the invention and are not to be limited to the embodiments and states so specifically listed. Should be.

In addition, it is to be understood that all detailed descriptions, including the principles, aspects, and embodiments of the present invention, as well as listing specific embodiments, are intended to include structural and functional equivalents of these matters. In addition, these equivalents should be understood to include not only equivalents now known, but also equivalents to be developed in the future, that is, all devices invented to perform the same function regardless of structure.

Thus, for example, it should be understood that the block diagrams herein represent a conceptual view of example circuitry embodying the principles of the invention. Similarly, all flowcharts, state transitions, pseudocodes, and the like are understood to represent various processes performed by a computer or processor, whether or not the computer or processor is substantially illustrated on a computer readable medium and whether the computer or processor is clearly shown. Should be.

The functionality of the various elements shown in the figures, including functional blocks represented by a processor or similar concept, can be provided by the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, by a single shared processor or by a plurality of individual processors, some of which may be shared.

In addition, the explicit use of terms presented in terms of processor, control, or similar concept should not be interpreted exclusively as a citation to hardware capable of running software, and without limitation, ROM for storing digital signal processor (DSP) hardware, software. (ROM), RAM, and non-volatile memory are to be understood to implicitly include. Other hardware for the governor may also be included.

In the claims of this specification, components expressed as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements or firmware / microcode, etc. that perform the functions. It is intended to include all methods of performing a function which are combined with appropriate circuitry for executing the software to perform the function. The invention, as defined by these claims, is equivalent to what is understood from this specification, as any means capable of providing such functionality, as the functionality provided by the various enumerated means are combined, and in any manner required by the claims. It should be understood that.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a network including a control device and a control target device according to an exemplary embodiment of the present invention.

The control device 100 and the

control target devices

200 and 300 access a network to exchange information for content conversion. In one embodiment, the network may be a home network according to UPnP or DLNA.

As described above, the control device 100 connected to the network may include a control point, and the control target device may include a control target device 200 including a media server, and a control target device 300 including a media renderer. It can be divided into.

The media server stores and manages the content, and provides a function of converting the content, transmitting or streaming the content according to the request of the control device 100. In addition, the media renderer provides a function of receiving and playing back the converted content from the network.

Accordingly, the control target device 200 including a media server may mean a device that can be stored, such as a computer, a network access server (NAS), a phone, and the control target device 300 including a media renderer is a BD / DVD. It may mean devices capable of playing received content such as a player, a set top box, a TV, and the like.

As such, the control target device including the media server may be referred to simply as a media server or a digital media server (DMS) as described above, and the control target device including the media renderer may be a media renderer or the above. One may be referred to as a digital media renderer (DMR).

Meanwhile, the control device 100 includes a control point, and the control point provides the AV service to the user by controlling the function of converting, storing, transmitting, streaming, and playing the content of the media server 200 and the media renderer 300. It performs the function. As such, the control device 100 that provides the AV service using the control point may be referred to as a digital media controller (DMC) or simply the control point device 100.

Hereinafter, a content conversion method according to an embodiment of the present invention will be described in detail with reference to FIG. 2.

First, the control point apparatus 100 requests content information from the media server 200 (S1000).

The control point apparatus 100 may request content information by transmitting a content information request message to the media server 200. The content information request message may include a content list request message included in the media server 200.

For example, the content information request message may include a browse action (Browse ()) or search action (Search ()) message for a content directory service (CDS) provided by the media server 200. . The content information request message including a browse action (Browse ()) or search action (Search ()) may include, for example, request information of content objects included in the media server 200, and the content objects are assigned to each content. The metadata may include corresponding metadata, and may include content profile information corresponding to each content. The content profile information may include at least one of the format, bitrate, scale, and rotation information of the content.

Thereafter, the media server 200 transmits content information to the control point apparatus 100 (S1005).

The media server 200 may provide a content directory service as described above. When the media server 200 receives the content information request message, the media server 200 may generate content information about the contents stored in the media server 200 and transmit the content information to the control point device 100 using the content directory service. As described above, the content information may include content objects, and the content objects may include content profile information corresponding to each content.

The control point device 100 receives a user selection input for the received content information (S1010).

The control point device 100 may display a list of contents included in the media server 200 on the user interface based on the received content information. In addition, the control point apparatus 100 may receive a user selection input for the displayed user interface. The user may select content to be played back from the displayed content list.

Therefore, when the control point device 100 receives a user selection input through the user interface, the control point device 100 may perform a playback operation on the content to be selected.

Meanwhile, the user interface may receive a user input in various ways such as touch input, key input, soft key input, gesture, motion sensing, and the like, and a detailed operation method will be described later.

The control point device 100 requests protocol information from the media renderer 300 (S1010).

If there is a user selection input, the control point device 100 may request protocol information from the media renderer 300 to determine whether the media renderer 300 is playable. In addition, the control point apparatus 100 may request and store the protocol information from the media renderer 300 even before a user selection input.

The control point apparatus 100 may request protocol information from the media renderer 300 by transmitting a protocol information request message. The protocol information request message may include a protocol information action GetProtocolInfo () for a connection manager service provided by the media renderer 300.

The protocol information may include transmission protocol information that can be received by the media renderer 300 and data format information that can be reproduced by the media renderer 300. For example, the transmission protocol may include IEEE 1394, HTTP GET, RTSP / RTP, and the like, and the data format information may include MPEG2, MPEG4, MP3, WMA, JPEG, and the like. Therefore, the control point apparatus 100 may determine a transmission protocol and a playable data format that the media renderer 300 can receive using the protocol information.

When the media renderer 300 receives the protocol information request message, the media renderer 300 generates the protocol information and transmits the protocol information to the control point apparatus 100 (S1020). As described above, the media renderer 300 may generate protocol information of the media renderer 300 according to the protocol information request action provided by the connection management service, and transmit the protocol information to the control point device 100.

In operation S1025, the control point apparatus 100 performs capability matching.

The control point apparatus 100 may perform capability matching by comparing and determining the profile information of the content selected in step S1010 and the protocol information of the media renderer 300.

The capability matching may mean an operation of determining whether the media renderer 300 can play the specific content selected in operation S1010.

According to an embodiment of the present disclosure, the control point apparatus 100 may extract a playable data format or a transmission protocol from protocol information received by the media renderer 300, and determine whether to play a specific content based on this.

According to an embodiment, the control point apparatus 100 plays back the media renderer 300 when the data format or transmission protocol included in the protocol information matches the data format or transmission protocol included in the profile information corresponding to the selected specific content. It can be judged as possible.

For example, if the protocol information received from the media renderer 300 includes only WMV, but the MPEG2 is specified in the profile information of the user-selected content, the control point apparatus 100 may determine that the protocol information does not match. In addition, the control point apparatus 100 may determine that the capability is matched when the protocol information received from the media renderer 300 includes MPEG2, MPEG4, WMV, and MPEG4 is specified in the profile information of the user selected content. have.

In addition, the control point apparatus 100 determines whether matching fails (S1030). If the matching is successful, the selected content can be played in the media renderer 300 without any problem, so that the control point device 100 performs a streaming operation of the media renderer 300 and a playback operation of the media renderer 300 in the media server 200. To control (S1035).

However, if the matching fails, the control point device 100 requests the media server 200 for the conversion information (S1040).

The control point device 100 may request the conversion information by transmitting the conversion information request message to the media server 200. The transformation information request message may include a transformation permission request action (GetAllowedTransforms ()) for the content directory service provided by the media server 200. The GetAllowedTransforms () action may be expressed as a message in XML format that requests transformation information for performing the transformation function when the content directory service includes the transformation function.

The transformation information may include, for example, transformation capability information. The conversion capability information may include information on a data format, bitrate, scale, and rotation, which can be converted by the media server 200. In addition, the conversion capability information may include output profiles for each input profile. For example, the conversion capability information may include MPEG2, MPEG4, etc. as an input profile, and may include WMV as an output profile.

The media server 200 transmits the conversion information to the control point apparatus 100 (S1045).

When the content directory service provided by the media server 200 provides a conversion function, the media server 200 may transmit the conversion information to the control point device 100 in response to the conversion information request. The conversion information may include data format or profile information that the media server 200 can convert.

When the control point device 100 receives the conversion information, the control point device 100 sets a conversion process (S1040).

The control point apparatus 100 may determine a data format to be converted based on the profile information of the content that fails to match, the protocol information and the conversion information of the media renderer 300, and set the conversion process accordingly. The conversion process may, for example, indicate information about which content to convert from which format to which format.

The control point apparatus 100 may determine optimal data formats that can be played in the media renderer 300 from protocol information. The control point apparatus 100 may determine which format the data format of the selected content can be converted in the media server 200 based on the conversion information. Accordingly, the control point apparatus 100 may determine a data format that can be converted in the media server 200 and can be smoothly reproduced in the media renderer 300, and thus, may determine a conversion process.

Thereafter, the control point device 100 requests the media server 200 to start the conversion (S1045).

The control point apparatus 100 may request a conversion start by generating a conversion start request message based on the determined conversion process and transmitting the message to the media server 200.

The transformation start request message may include a transformation start action (StartTransform ()) command for the directory service of the media server 200. In addition, the conversion start request message may include conversion process information. The conversion process information may include at least one of identification information of the content to be converted, input profile information of the content to be converted, profile information of the content to be output after conversion, and identification information of the content to be output after conversion.

The control point apparatus 100 may designate the selected content as the content to be converted, generate the conversion start request message by specifying the content to be output by the conversion process, and transmit it to the media server 200.

When the media server 200 receives the conversion start request, the media server 200 transmits the conversion start response to the control point device 100 (S1050).

The media server 200 may receive a conversion start request message and obtain conversion process information based on the conversion start request message. The conversion process information may include identification information of the content to be converted, input profile information, output profile information, and identification information of the content to be output, as described above.

The media server 200 may start the conversion based on the obtained conversion process information, and transmit the conversion start response to the control point device 100. The conversion start response may indicate whether the conversion process information has been successfully received and conversion has started normally.

Upon receiving the conversion start response, the control point apparatus 100 requests the media server 200 for the conversion progress state (S1055).

The control point apparatus 100 may transmit a conversion progress information request message indicating how much the current conversion is performed to the media server 200. The transformation progress information request message may include a transformation progress request action (GetTransformProgress ()) command for the content directory service of the media server 200 described above.

In addition, the conversion progress information may indicate not only how much the current conversion is performed, but may also include identification information and profile information of the input content and identification information and profile information of the content to be output.

Therefore, the control point apparatus 100 may receive the conversion progress status information (S1060), and determine the progress status of the conversion process currently in progress in the media server 200.

In addition, the control point apparatus 100 may output the current conversion state to the user based on the determined conversion progress state information. The control point device 100 may indicate the conversion progress state to the user by using an audio or video, and may output profile information about the content to be converted and the content to be output after the conversion.

For example, the control point apparatus 100 may display that the conversion is in progress because the content corresponding to the current user selection input cannot be played in the media renderer 300. In addition, the control point apparatus 100 may allow the user to recognize the process by displaying the progress of the conversion, the format of the content to be converted, and the format of the content output after the conversion. . Meanwhile, the control point device 100 may perform the conversion in the background without outputting the conversion progress state for users who are not familiar with the device.

Thereafter, the media server 200 determines whether the conversion is completed (S1063). When the conversion is completed, the media server 200 transmits the conversion result to the control point apparatus 100 (S1065).

When the conversion is completed, the media server 200 may generate a conversion result message and transmit it to the control point device 100. The conversion result message may include XML data, and the conversion result message may be transmitted to all the control point devices 100 or the control target devices connected to the network by using an event method.

The conversion result message may include identification information of the converted content and profile information of the converted content.

When the control point device 100 receives the conversion result message, the control point device 100 requests a connection preparation to the media server 200 (S1070), and receives a response to the connection preparation request from the media server 200 (S1075).

The control point apparatus 100 may prepare a connection between the media server 200 and the media renderer 300 by transmitting a connection preparation request message and receiving a response thereto.

The connection preparation request message may include, for example, a connection preparation action (PrepareForConnection ()) command for the connection management service. The connection preparation request message may include setting information for AV transmission or streaming service of an AV service to be started later. Accordingly, the connection preparation request message may include at least one of identification information, data format information, and transmission protocol information of content to be transmitted from the media server 200 to the media renderer 300.

In addition, the control point apparatus 100 may include the identification information and data format information of the converted content and the transmission protocol information from the media server 200 to the media renderer 300 in the connection preparation request message.

In addition, the media server 200 may perform connection preparation based on the received connection preparation request message, and generate a connection preparation response message and transmit the generated connection preparation response message to the control point device 100 according to success. The media server 200 may load, for example, a previously converted content into a memory and set a protocol for transmission, for an AV service to be performed later.

On the other hand, upon receiving the conversion result message, the control point apparatus 100 requests the media renderer 300 to prepare for connection (S1080), and receives a response to the connection preparation request from the media renderer 300 (S1085).

The connection preparation request message may include a connection preparation action (PrepareForConnection ()) command for the connection management service, as described above. The connection preparation request message may include setting information for an AV streaming service to be started later. Accordingly, the connection preparation request message may include at least one of identification information, data format information, and transmission protocol information of content to be transmitted from the media server 200 to the media renderer 300 described above.

When the connection preparation is completed, the media renderer 300 may generate a connection preparation response message including information on whether the connection preparation is successful and transmit it to the control point device 100.

Thereafter, the control point apparatus 100 transmits a transmission URI setting message to the media renderer 300 (S1090), and receives a response message from the media renderer 300 (S1095).

The transmission URI setting message may include URI information for allowing the media renderer 300 to receive specific AV data from the media server 200. The transport URI setting message may include, for example, an AV transport URI setting action (SetAVTransportURI ()) command defined in the UPnP AV service. The media renderer 300 obtains a URI capable of receiving AV data transmitted from the media renderer 300 based on the transmission URI setting message, and connects to the media server 200 based on the obtained URI, thereby providing the AV data. You are ready to receive it.

When the setting is completed, the media renderer 300 transmits a transmission URI response message including information on whether the setting is performed to the control point device 100.

Thereafter, the control point apparatus 100 transmits a playback command to the media renderer 300 (S1100), and receives a response to the playback command from the media renderer 300 (S1105).

The play command may include a play action (Play ()) command of an AV service defined in UPnP. The play command may include operation information for playing the specific content in the media renderer 300. The playback command may include, for example, identification information and playback speed information of content to be played back.

In addition, the playback command may include identification information of the converted content as described above. Accordingly, the media renderer 300 may receive and play the converted content based on the received playback command. For example, the media renderer 300 may access the path where the converted content is located in the media server 200 using the above-described transmission URI.

The media server 200 streams the converted content to the media server 200 (S1115). When the media renderer 300 accesses the path where the converted content is located by using the transmission URI, the media server 200 may stream the converted content to the media server 200.

In addition, when the media server 200 streams the converted content, the media renderer 300 may play the converted content in real time. The media renderer 300 may receive a streaming service of the converted content and play back a file such as an image, a sound, or an animation in real time without separately storing the file in a storage space of the receiving device. However, the media renderer 300 or the media server 200 may store the converted content in a specific storage space according to a user selection input to the control point device 100, or may store the converted content in advance. This will be described later.

Referring to FIG. 3, first, the control point apparatus 100 requests content information from the media server 200 (S1200), and the media server 200 responds to the content included in the media server 200 in response thereto. The content information is transmitted to the control point device 100 (S1205). As described above, the content information may include a content object corresponding to each content included in the media server 200. The content object may include metadata about each content and may include profile information corresponding to each content. The profile information may include at least one of a data format, bitrate, scale, and rotation information corresponding to each content.

The control point apparatus 100 receives a user selection input in operation S1210. As described above, the control point device 100 may receive a user selection input through a user interface. The control point device 100 may select any one of contents included in the media server 200 according to a user selection input.

The control point apparatus 100 requests protocol information from the media renderer 300 (S1215). The media renderer 300 transmits protocol information of the media renderer 300 to the control point device 100 in response to the request. As described above, the protocol information may include information about a transport protocol and a playable data format that can be received by the media renderer 300.

The control point apparatus 100 performs capability matching (S1225). As described above, the capability matching may mean that the control point apparatus 100 determines whether profile information corresponding to the selected content matches protocol information of the media renderer 300. The control point apparatus 100 extracts profile information of the selected content from the content information received from the media server 200, and matches data format information included in the extracted profile information to protocol information received from the media renderer 300. It can be determined whether or not to perform the ability matching. By performing the capability matching, the control point apparatus 100 may determine whether the data format of the selected content is playable in the media renderer 300.

In addition, the control point apparatus 100 determines whether the matching is successful (S1230), and when the matching fails, the control point apparatus 100 performs a subsequent process from step S1040 to convert.

However, if the matching is successful, the control point apparatus 100 relays a file streaming process of the selected content between the media server 200 and the media renderer 300 (S1235). In the file streaming process, as described above, the control point device 100 transmits a request to prepare the connection between the media server 200 and the media renderer 300, receives the response, and transmits the response to the media renderer 300. When the URI is set, the method may include transmitting a play command and receiving the selected content from the media server 200 by accessing the media renderer 300 according to the play command.

In response to file streaming, the media renderer 300 may provide a service of playing selected content according to a user selection input.

On the other hand, due to changes in the network environment during playback, the transmission width of the data can be narrowed or the transmission rate can be lowered. Accordingly, file streaming may be interrupted. Therefore, in order to play smoothly when streaming files, it is necessary to convert the bit rate or the codec of the content according to the change of the network environment and transmit the data without interruption even at a low data rate.

Therefore, the control point apparatus 100 determines whether conversion is necessary (S1237).

The control point apparatus 100 may determine whether the conversion is necessary by detecting a change in the network environment. In addition, the control point device 100 may determine whether the conversion is necessary according to whether the currently detected network environment is lower or higher than a preset condition. In addition, the control point apparatus 100 may determine whether to convert according to a user input.

For example, when a file streaming interruption occurs due to a deterioration of the network environment, and a degradation in the quality of an AV that a user watches through the media renderer 300 occurs, the user may input a conversion command through a user interface. .

Also, for example, the control point device 100 may detect whether the control point device 100 cuts off the screen and inquire the user of the conversion, and determine whether the conversion is necessary according to a user input for the query.

If it is determined that the conversion is necessary, the control point device 100 requests the conversion information to the media server 200 (S1240), and receives the conversion information in response (S1245). The conversion information may include conversion capability information of the media server 200 as described above, and the conversion capability information may include information on a data format, bitrate, scale, and rotation that are convertible in the media server 200. Can be. In addition, the conversion capability information may include output profiles for each input profile.

The control point apparatus 100 sets a conversion process based on the conversion information (S1250).

The control point apparatus 100 may set the conversion process according to the change of the network environment. For example, when the network environment is degraded, the control point device 100 may set a content conversion process for converting content that is currently streamed to low quality. In addition, when the network environment is degraded, the control point device 100 may set a conversion process for converting the currently streamed content into a data format resistant to network environment changes. The conversion process setting process is as described above.

The control point apparatus 100 transmits a conversion start request to the media server 200 (S1255), and receives a response thereto (S1260). The conversion start request message may include information about the conversion process, as described above.

The media server 200 performs the conversion in accordance with the conversion start request (S1265). The media server 200 changes the transmission URI to correspond to the converted content (S1270).

The media server 200 may change the transmission URI to correspond to the converted content instead of the existing streamed content, and set the converted file to be streamed. Accordingly, the media renderer 300 can play the converted content without changing the transmission setting.

Accordingly, the media server 200 streams the converted content file to the media renderer 300 (S1275). As such, the control point apparatus 100 controls content conversion of the media server 200 according to a change in network environment, thereby enabling seamless streaming content playback in the media renderer 300.

On the other hand, if the media server 200 is unable to convert the content into a profile that can be played by the media renderer 300, there is a problem that can not be converted and streamed.

To solve this problem, in an embodiment of the present invention, a virtual transformer may collect conversion capability information of devices connected in a network and provide a conversion service using devices connected to the network. Such a translation service using network resources may be referred to as a virtual translation service. The present invention proposes a virtual conversion device, a virtual storage device and a virtual playback device to provide a virtual conversion service.

The virtual conversion apparatus 400 first requests device information from all devices connected to a network (S2000).

The virtual conversion apparatus 400 may convert specific content into another format by using devices connected to a network. To this end, the virtual conversion device 400 needs to collect information of each device connected to the network.

In one embodiment, the virtual conversion device may be a separate conversion device physically separated, but may also refer to a control point device, a media server, or a media renderer that provides a virtual conversion service on a network. In addition, the virtual transformation apparatus may refer to a group of a plurality of devices that provide a virtual transformation function. In addition, the virtual conversion apparatus may include an MSCP (Medium Server Control Point) on UPnP protocol for controlling the media server, and may include an MRn (UPnP Media Renderer Control Point) on UPnP protocol for controlling the media renderer. .

The virtual conversion apparatus 400 may request device information from the first to N th devices connected to the network and perform device discovery. The device information may indicate identification information, IP address or port information of each of the first to Nth devices located on the network. Therefore, the virtual conversion apparatus 400 may multicast the device information request message to all devices connected to the network, and receive the response to collect identification information, IP address, or port information about the devices connected to the network. have.

For example, the virtual conversion apparatus 400 may multicast the discovery message using the Simple Service Discovery Protocol (SSDP) to identify other devices operating on the network.

Then, the virtual conversion device 400 receives a response to the device information request (S2015).

Devices on the network that receive the device information request message transmitted from the virtual conversion device 400 may unicast a response message to the virtual conversion device 400 in response to the received device information request message. Through this, the virtual conversion device 400 may discover devices connected to the network, and list and manage identification information of each device for later conversion. Processes S2000 to S2015 may be referred to as device discovery processes.

Thereafter, the virtual conversion device 400 requests conversion capability information from the listed devices (S2035, S2040, and S2045). The virtual conversion device 400 may request information about conversion capabilities that can be converted by each device connected to the network. The virtual conversion apparatus 400 receives the conversion capability information in response to the request for the conversion capability information from each device (S2050, S2055, and S2060).

The virtual conversion apparatus 400 may generate a conversion capability information request message and multicast to the devices connected to the network. The conversion capability information request message may include, for example, an action instruction requesting convertible output data formats for a particular data format.

For example, the virtual transformation apparatus 400 may designate an input variable of an action command included in the transformation capability information request message in a specific input file format and transmit the input variable to a device connected to a network. In addition, the virtual conversion apparatus 400 may specify metadata for all file formats as input variables and transmit them to each device without specifying an input file format. In this case, the virtual conversion apparatus 400 may collect only conversion capability information for converting a specific input file format, and may reduce the amount of data required for transmission and reception.

The virtual conversion apparatus 400 may receive the conversion capability information in response to the conversion capability information request, and collect outputable file format information corresponding to a specific input file format or all file formats.

The conversion capability information may include, for example, input profile information and output profile information. Each profile information may include at least one of data format, bitrate, scale, and rotation information.

In addition, the conversion capability information may include conversion capability information. The conversion performance information may include, for example, time information required to perform a conversion in each device. Such time information may indicate the time required to convert content having an arbitrary file size and profile into a specific output profile.

The virtual transformation apparatus 400 may collect such transformation capability information and store the transformation capability information in correspondence with the above-described apparatus information. For example, the virtual conversion apparatus 400 may generate a mapping table that maps all convertible output file formats corresponding to the input file format and store the mapping table. In addition, the virtual conversion apparatus 400 may store devices that can be converted into a specific output file in a mapping table corresponding to the specific input file.

Therefore, the virtual transformation apparatus 400 may determine the transformation capability and the transformation capability of each device connected to the network based on the collected transformation capability information when performing the transformation later. In addition, the virtual conversion apparatus 400 may classify and store the conversion capability information for each device, and transfer the conversion capability information stored for each device according to a request to another device. For example, the virtual conversion apparatus 400 may transmit the stored mapping table to another device.

The virtual storage device 500 may collect and manage storage information of each device connected to a network in order to store the converted content. In addition, the virtual storage device 500 may transmit the storage capability and state information of each device connected to the network to the control point device 100 or the virtual conversion device 400.

In an embodiment, the virtual storage device may be a separate storage device that is physically separated, but may also refer to a control point device, a media server, or a media renderer that can provide a media storage service on a network. In addition, the virtual storage device may refer to a group of a plurality of devices that provide a virtual storage function. In addition, the virtual storage device may include a MSCP (Medium Server Control Point) on the UPnP protocol for controlling the media server.

First, the virtual storage device 500 performs device discovery with each device connected to a network (S2100). The device discovery process is as described above in the description of the virtual conversion device.

The virtual storage device 500 requests storage information from each of the networked devices (S2135, S2140, and S2145), and receives the storage information from the devices in response thereto (S2150, S2155, and S2160).

The storage information may include storage capability information and storage state information of each device. The storage capability information may indicate a total storage space of each device, and the storage state information may indicate a storage space currently free for each device.

The virtual storage device 500 may collect such storage information and store the information in correspondence with the above-described device information. Therefore, the virtual storage device 500 may determine the storage capacity and the storage state of each device connected to the network based on the storage information.

The virtual storage device 500 receives a storage capacity and a storage state request from the control point device 100 (S2165), and transmits storage capacity and storage state information of each device in response thereto (S2170). The virtual storage device 500 may classify and store the storage information for each device, and may transmit and store the storage capacity and the storage state of each device according to a request of the control point device 100. To this end, the virtual storage device 500 may include a media server device (MSD) function defined by UPnP.

The virtual playback device 600 may collect and manage playback capability information of each device connected to the network in order to determine a playback capability of each playback device (media renderer) connected to the network. In addition, the virtual storage device 500 may transmit the reproduction capability information of each device connected to the network to the control point device 100 or the virtual conversion device 400.

In one embodiment, the virtual playback device may be a separate playback device that is physically separated, but may also refer to a control point device, a media server, or a media renderer that provides a virtual playback service on a network. In addition, the virtual storage device may refer to a group of a plurality of devices that provide a virtual storage function. In addition, the virtual storage device may include a MSCP (Medium Server Control Point) on the UPnP protocol for controlling the media server.

First, the virtual reproducing apparatus 600 performs device discovery with each device connected to a network (S2200). The device discovery process is as described above in the description of the virtual conversion device.

The virtual reproducing apparatus 600 requests the reproducing capability information from each of the network-connected devices (S2235, S2240, and S2245), and receives the reproducing capability information from the respective devices in response thereto (S2250, S2255, and S2260). .

The reproduction capability information may include input profile information that each reproduction apparatus can reproduce. The input profile information may include, for example, playable file format, bitrate, scale or rotation information.

The virtual reproducing apparatus 600 sends a protocol information request action (GetProtocolInfo ()) message of a connection management service (CMS) defined by UPnP to each reproducing apparatus connected to the network in order to request such reproduction capability information. Can be multicast

The virtual reproducing apparatus 600 may collect reproducing capability information in response to the reproducing capability information request and store the reproducing capability information in correspondence with the above-described device information. Accordingly, the virtual playback device 600 may collect, store, and manage the playback capabilities of the devices connected to the network.

In addition, the virtual reproduction apparatus 600 receives a reproduction capability information request from the control point apparatus 100 (S2165), and transmits reproduction capability information of each reproduction apparatus in response thereto (S2170). The virtual reproducing apparatus 600 may classify and store the reproducing capability information for each device, and list and reproduce the reproducing capabilities for each device according to a request of the control point device 100. To this end, the virtual playback device 500 may include a Media Renderer device (MRD) function defined by UPnP.

According to an embodiment, the virtual conversion apparatus 400 may include a control point. In addition, the virtual conversion apparatus 400 may provide a conversion service by controlling devices connected to a network through a control point.

To this end, the virtual conversion apparatus 400 may register the devices connected to the network by performing the device discovery process described above before the content conversion process. Devices connected to the network may include, for example, DMS1 (Digital Media Server 1), DMS2 (Digital Media Server 2), DMR (Digital Media Renderer), and the like, as shown in FIG. The virtual conversion apparatus 400 registers device information (identification information, IP address, port number, etc.) of each device connected to the home network through a device discovery process, and requests a request message to be described later based on the registered device information. It may transmit to each device or receive a response message from each device.

When the virtual conversion device 400 receives a user input for searching for content, the virtual conversion device 400 may access the DMS1 or the DMS2 based on the device information, and then receive and display the content information included in each device. In FIG. 7, it is assumed that a user receives a user input for searching for content included in DMS2. However, the present invention is not limited to the search target device.

First, the virtual conversion apparatus 400 requests content information from the DMS2 720, which is a search target device (S3000), and receives content information from the DMS2 720 in response thereto (S3005). The virtual converter 400 requests protocol information from the DMR 730, which is a playback target device (S3010), and receives protocol information from the DMR 730 in response (S3015). The content information request and response process and the contents included in the content information have been described above, and the protocol information request and response process and the contents included in the protocol information have been described above.

The virtual conversion apparatus 400 determines whether the user-selected content can be played back in the DMR 730 (S3020).

The virtual conversion apparatus 400 may display a content list included in the DMS2 720 based on the content information, and receive a content selection input that the user wants to play through the user interface. In addition, it may be determined whether the user-selected content is playable in the DMR 730 based on the profile information on the user-selected content and the protocol information received from the DMR 730.

In addition, when reproducible, the virtual conversion apparatus 400 may perform a general file streaming operation without a conversion process, or may transmit a message so that another control point device performs the general file streaming operation.

However, if the reproduction is impossible, the virtual conversion device 400 requests conversion information from each device connected to the network.

The virtual conversion apparatus 400 requests the conversion information to the DMS2 720 (S3025), receives the conversion information of the DMS2 in response (S3030), requests the conversion information to the DMS1 710 (S3035), and In response to receiving the conversion information of the DMS1 (S3040), the DMR 730 also requests conversion information (S3045), and receives the conversion information of the DMR (S3050). The request and response process of the conversion information is as described above.

In addition, the virtual conversion apparatus 400 may not only perform such a conversion information collection operation when the conversion is necessary, but also may repeatedly identify and store it in advance according to a predetermined period. Therefore, when the virtual conversion apparatus 400 requests and collects conversion information in advance, steps S3025 to S3050 may be omitted.

In operation S3055, the virtual conversion device 400 determines an output profile.

The virtual conversion apparatus 400 may determine the outputable profiles when converting the profile of the user-selected content based on the conversion information of the collected devices. The virtual conversion apparatus 400 may determine an output profile by selecting a profile that can be reproduced in the DMR 730 among the outputtable profiles based on the protocol information of the DMR 730.

In addition, the virtual conversion apparatus 400 may determine the output profile according to the priority, and the priority may include a plurality of preset output profile determination conditions. For example, the virtual conversion apparatus 400 may preferentially determine an output profile that can be converted in a media server (DMS2 in FIG. 7) or a media renderer (DMR in FIG. 7) to play the selected content. In addition, the virtual conversion apparatus 400 may convert and automatically determine one profile that is playable in the DMR 730 without user selection. In the case of two or more, the virtual conversion apparatus 400 selects a user through a user selection interface. It may be determined by receiving or automatically determined.

If the output profile is determined, the virtual conversion device 400 determines the device to perform the conversion (S3060).

The virtual conversion apparatus 400 may select a device to perform conversion based on the conversion information for each device collected above. In addition, if it is determined that there are two or more devices that can perform the conversion, the virtual conversion device 400 may determine that the media server having the selected content or the media renderer having the selected content is the device to be converted first. And, if it is determined that there are two or more devices that can perform the conversion, the virtual conversion device 400 extracts the conversion performance information from the conversion information for each device, and preferentially performs the conversion on the device having the highest transformation performance. Can be determined by the device.

If the device to be converted is determined, the virtual conversion device 400 determines whether to select storage (3065).

The virtual conversion apparatus 400 may determine whether to select a storage according to a preset condition, or may determine whether to select a storage based on a user input.

The virtual conversion apparatus 400 may query the user for storage selection and receive an input of storage selection through a user interface. The storage selection input may include a command of any one of storing, not storing, or alternative storage of the converted content. In FIG. 7, a case in which the user inputs not to store is described. In other cases, the virtual conversion apparatus 400 performs a storage or replacement storage operation to be described later.

When it is determined that storage is not selected according to a user input, the virtual conversion apparatus 400 transmits a conversion start request to the DMS2 720 determined as the device to be converted (S3070), and receives the response (S3075).

The conversion start request message may include output profile information determined in steps S3055 and S3060 and device information to be converted. In addition, when the storage is selected, the storage device information determined in operation S3065 may be further included, which will be described later.

Then, the DMS2 720 starts the conversion (S3080) and starts the streaming of the converted content (S3085). Accordingly, the DMS2 720 performs file streaming of the converted content to the DMR 730 (S3090), and the DMR 730 receives and plays the content, thereby providing a service for playing the converted content to the user. .

The DMS2 720 may acquire content identification information, an input profile, and an output profile based on the streaming conversion start request message, and perform content conversion based on the content identification information.

In addition, the DMS2 720 may perform file streaming during the conversion process, or may perform file streaming after the conversion is completed for stable transmission.

When the content conversion is completed, the DMS2 720 may terminate the conversion (S3095) and terminate the streaming service.

Steps S3100 to S3160 of FIG. 8 are output device determination and conversion determination processes according to the same matching failures as steps S3000 to S3060 of FIG. 7 and will not be described in detail.

In operation S3165, the virtual conversion apparatus 400 determines whether the user selects an alternative storage.

As described above, the user may input alternative storage into the virtual conversion apparatus 400 through the user interface. When the alternative storage is selected, the virtual conversion apparatus 400 may control the server device that has performed the conversion to replace the previous content with the converted content and store the converted content.

Therefore, when the alternative storage is selected, the virtual conversion apparatus 400 generates a conversion start request message including an alternative storage command, and transmits it to the DMS2 720 (S3170).

Upon receiving the conversion start request, the DMS2 720 starts the conversion on the basis of the conversion start request message (S3180), and starts streaming and alternate storage of the converted content (S3185). When the converted content is streamed, the DMR 730 receives and plays the received content and provides a streaming service in operation S3190.

When the content conversion is completed, the DMS2 720 may terminate the conversion, complete the alternative storage (S3095), and terminate the streaming service.

By this alternative storage operation, when the same content is later played, streaming can be performed immediately without conversion, thereby reducing waste of network resources.

If storage is selected in the storage selection process of the above-described virtual conversion device 400, selecting the device to be stored through the virtual storage device 500 described above, and transmitting the converted content from the converted device to the storage-selected device. This may be necessary.

First, the virtual transformation apparatus 400 performs the output profile determination process according to the matching failure as described above (S3200), and determines the apparatus to perform the transformation (S3205).

In operation S3210, the virtual conversion apparatus 400 determines whether the user has selected to store the converted content. As described above, the virtual conversion apparatus 400 may determine whether to select storage based on a user input. If the storage is not selected, the virtual conversion device 400 determines not to store or substitute storage, and may perform an appropriate operation according to the above-described method.

On the other hand, the virtual storage device 500 requests the storage information to the DMS2 720 (S3215), receives the storage information of the DMS2 720 in response (S3220), and requests the storage information to the DMS1 (710) In operation S3225, the storage information of the DMS1 710 is received in operation S3230. Here, the order is not important, and may store the storage information of the DMS1 710 first. Also, steps S3215 to S3230 may be periodically performed by the virtual storage device 500.

As described above, the virtual storage device 500 may request storage information from all server devices connected to a network, and receive storage information of each device in response. In FIG. 9, the virtual storage device 500 may receive, store, and manage storage information of the DMS1 710 and storage information of the DMS2 720. Accordingly, the most storage device 500 may determine the total storage space and available space of the DMS 710 and the DMS2 720, and store the data in the form of a table or a list.

In operation S3210, when storage is selected, the virtual conversion apparatus 400 requests storage information from the virtual storage apparatus 500 in operation S3235. The virtual storage device 500 transmits the storage information to the virtual conversion device 400 in response (S3240).

The virtual converter 400 may request storage information from the virtual storage device 500 to select a storage device. The virtual conversion apparatus 400 may receive the storage information collected in advance by the virtual storage device 500 to obtain information on the total storage space and available space of the

server devices

710 and 720.

The virtual conversion apparatus 400 displays a storage interface in operation S3245. The virtual conversion apparatus 400 may display the storage interface based on the information about the total storage space and available space of each of the acquired

server devices

710 and 720. The storage interface may include, for example, a query menu for querying which device of the DMS1 710 and the DMS2 720 to store. In addition, the storage interface may include a file naming menu of newly stored content when the converted file is newly stored. The storage interface may include an automatic storage menu, and the virtual conversion apparatus 400 may select a server device and a file name according to a preset storage rule when selecting the automatic storage menu, and display the result to the user. .

The user may determine the storage capacity information of each DMS according to the output of the virtual conversion apparatus 400 and select a DMS to store the converted content through the storage interface.

The virtual conversion apparatus 400 receives a storage device selection input from a user (S3250), and selects a storage device based on the received storage device selection input (S3255). In an embodiment, it is assumed that the DMS2 720 is selected as a storage device by a user selection input, but the type of the storage device is not limited.

After the storage device is selected, the virtual conversion device 400 transmits a conversion start request to the DMS2 720 determined as the device to be converted (S3260), and receives a response thereto (S3265). When the storage device is selected, the conversion start request message may further include information on a device for storing the converted content and a file name of the content to be stored, in addition to the above-described content identifier, input profile, and output profile.

Upon receiving the conversion start request, the DMS2 720 starts the conversion on the basis of the conversion start request (S3270). In operation S3280, the DMS2 720 starts streaming of the converted content, and stores the data of the converted content in its own storage space designated as the storage device. Accordingly, the converted content may be streamed to the DMR 730 and simultaneously stored in the DMS2 720. The DMR 730 may play the converted content that is streamed.

On the other hand, when streaming is completed, the DMS2 720 may complete the conversion and storage (S3290), specify a file name set by the user or a file name based on a preset rule, and correspond to the converted content.

FIG. 10 is a ladder diagram illustrating a case in which a device to be converted is determined as DMS2 720 and a user selects DMS1 710 as a storage device. Steps S3300 to S3355 are the same as the processes described with reference to FIG. 9, and thus description thereof will be omitted.

When the user selects the DMS1 710 as the storage device, the virtual conversion device 400 first transmits a conversion start request to the DMS2 720, which is a device to perform conversion (S3360), and receives a response (S3365). The conversion start request message may further include identification information of the DMS1 710, which is a device to be stored, and file name information to be assigned to the converted content, in addition to the content identifier, the input profile, and the output profile.

Receiving such a conversion start request, the DMS2 720 starts conversion (S3370) and starts streaming of the converted file (S3375). The converted content is streamed (DMR 730) (S3380), thereby enabling real-time playback.

Meanwhile, the DMS2 720 transmits a file constituting the converted content to the DMS1 710 which is a storage device (S3385). The DMS1 710 stores the transmitted file in the storage space (S3390).

According to an embodiment, the DMS2 720, which is a device that performs conversion, may stream the converted content to the DMR 730, which is a playback device. At the same time, the DMS2 720 may also transmit the converted content to the DMS1 710 which is a storage device. Accordingly, efficient conversion, reproduction, and storage using home network resources is achieved.

Thereafter, when the conversion is completed (S3395), the DMS2 720 may end the streaming, and the DMS1 710 may complete the storage of the converted content.

According to an embodiment, the device for storing the converted file may simultaneously perform streaming of the converted content. For example, if it is determined that the conversion performance of the DMS2 720 is low and it is difficult to simultaneously perform streaming, the virtual conversion apparatus 400 may designate a storage device to be streamed to the DMS1 710 and transmit the same.

11 illustrates a case of simultaneously storing and streaming content converted in the DMS1 710.

Referring to FIG. 11, as described above, operations S3400 to S3420 represent a process of starting a conversion through a process of determining an output profile according to a matching failure, and a process of determining a device to be converted and a storage device.

Thereafter, the DMS2 720 performing the conversion transmits the file constituting the converted content to the DMS1 710 which is a storage device (S3425).

In addition, the DMS1 710 receives and stores the converted content and performs streaming to the DMR 730 (S730). Thereafter, when the conversion is completed (3435), the DM1 710 may end the streaming, and complete the storage of the converted file with the specified file name.

12 illustrates a case where the content of the DMS2 720 is converted and stored in the DMS1 710.

In one embodiment, the server device holding the content may not be able to convert the content to another format. Therefore, the virtual storage device 500 may determine that another server device performs the conversion in operation S3505 and the device to perform the conversion after determining the output profile according to the matching failure (S3500).

The virtual conversion apparatus 400 transmits a conversion start request message to the DMS1 710 and receives a response thereto (S3515).

In one embodiment, the conversion start request message may include identification information of the content to be converted, and may further include conversion location information. The translation location information may include identification information of the server device where the content to be converted is located, for example, URI information. Accordingly, the DMS1 710 may access the DMS2 720, which is a server device on which the content to be converted is located, based on the conversion start request message, identify the content to be converted (original content), and receive the same.

Accordingly, the DMS1 710 receives a file constituting the original content from the DMS2 720 (S3525). As described above, the DMS1 710 requests a file transfer to the DMS2 720 according to the conversion start request message received from the virtual conversion apparatus 400, or directly accesses the URI of the DMS2 720 to the DMS2 720. Can receive original content.

Then, the DMS1 17 starts the conversion of the received original content (S3530). In operation S3535, the DMS1 17 performs streaming of the converted content and stores the converted content. Accordingly, the converted content is streamed from the DMS1 710 to the DMR 730, and the DMR 730 can play the streamed content.

Thereafter, when the conversion is completed (S3545), the DMS1 710 may complete streaming and file storage and terminate the operation.

FIG. 13 illustrates a case where the DMS1 710 is determined to be a device to perform conversion when the selected original content is in the DMS2 720, and the DMS2 is selected as a storage device of the converted content.

As described above, when it is determined that the DMR 730 cannot play back due to the profile matching failure, the virtual conversion apparatus 400 determines an output profile to be converted and output (S3600), and determines a device to be converted and a storage device. (S3605). As illustrated in FIG. 13, the DMS1 710 may be determined as a device to be converted, and the DMS2 may be selected as a storage device of the converted content.

Then, the virtual conversion apparatus 400 transmits a conversion start request to the DMS1 710 (S3610), and receives the response from the DMS1 710 (S3615). Then, the DMS1 710 receives the original content file from the DMS2 720 based on the conversion start request (S3625). As described above, the conversion start request message may further include location information of the original content, in addition to identification information, input profile, output profile, and storage location information of the original content. The location information of the original content may include path information for the server device performing the conversion to receive the original content through the home network. For example, the original content location information may include transmission URI information of the server device in which the original content is stored. In the present embodiment, the conversion start request message may include path information for receiving the original content of the DMS2 720.

Accordingly, the DMS1 710 may request a file transfer from the DMS2 720 based on the location information of the original content, or access the DMS2 720 to receive the original content.

Thereafter, the DMS1 710 starts converting the original content (S3630) and performs streaming of the converted content (S3635). Accordingly, the DMS1 710 may stream the converted content to the DMR 730 (S3640), and the DMR 730 may play the streamed content. Although a specific playback process is omitted in the present embodiment, as shown in FIGS. 2 and 3, the media renderer DMR 730 establishes a connection under the control of the virtual conversion apparatus 400 or the control point apparatus 100 and transmits the data. After the URI is set, when the play command is received, the content streamed from the DMS1 710 may be played.

In operation S3645, the DMS1 710 transmits the file of the converted content to the selected DMS2 720 as the storage device. The DMS1 710 may transmit the converted content to a specific location of the DMS2 720 based on the storage location information described above. In addition, the DMS2 720 receives the converted content and stores it (S3650).

FIG. 14 is a ladder diagram illustrating a case where the selected content is stored in the DMS2 720, the DMS1 710 is determined to be a device to be converted, and the DMS2 720 is selected as the storage device.

As shown in FIG. 14, the virtual conversion apparatus 400 determines an output profile according to a matching failure (S3700), determines a device to perform conversion according to the output profile, and determines a storage device (S3705). The virtual conversion apparatus 400 transmits a conversion start request to the DMS1 710, which is a device to be converted (S3710), and receives a response (S3715). Thereafter, the DMS1 710 obtains the original content identification information, the original content location information, the input profile information, and the output profile information included in the conversion start request message, and accesses the DMS2 720 based on the original content location information. The content is transmitted (S3725).

When transmission of the original content file is completed, the DMS1 710 starts the conversion of the original content (S3730). When the conversion is completed, the DMS1 710 transmits the converted file to the DMS2 720 (S3735). Here, the DMS1 710 may perform file transmission of the converted content after completion of conversion for stable streaming. In addition, the DMS1 710 may stream the converted file data to the DMS2 720 at the same time as the conversion is performed for real time streaming.

On the other hand, upon receiving the converted file, the DMS2 720 performs streaming processing on the DMR 730 and stores the converted file (S3740). Accordingly, the converted content may be streamed to the DMR 730. The DMR 730 can then play the converted file that is streamed.

As such, the virtual conversion apparatus 400 according to an embodiment of the present invention collects the conversion capability information of the devices connected to the network and receives and converts the storage information of the server devices connected to the network collected by the virtual storage device 500. The device to be performed and the storage device can be determined. Accordingly, the virtual conversion apparatus 400 may enable efficient conversion and storage of content that cannot be played in the media renderer using devices connected to a network, and may improve user convenience.

Referring to FIG. 15, a content conversion method of a control device and a control target device which perform conversion in advance according to an embodiment of the present invention will be described.

First, the virtual storage device 500 requests content information from server devices connected to a network, and receives the content information in response (S4000). The virtual storage device 500 may request, receive, store and manage content information of server devices connected to a network, for example, the DMS1 710 and the DMS2 720, as well as the storage information as described above. have.

The virtual reproduction apparatus 600 requests the reproduction capability information from the reproduction apparatuses connected to the network, and receives the reproduction capability information in response (S4000). The virtual reproducing apparatus 600 stores the reproducing capability information as described above, and the reproducing capability information of server devices connected to the network, for example, digital media servers 1 and 750 (DMR1) and digital media servers 2 and 720 (DMS2). You can request it, receive it, store it, and manage it. As described above, the reproduction capability information may include protocol information of each reproduction device, for example.

Thereafter, the virtual conversion device 400 requests content information from the virtual storage device 500 (S4015), and receives content information of each server device in response thereto (S4020). The virtual conversion apparatus 400 requests the reproduction capability information from the virtual reproduction apparatus 600 (S4025), and receives the reproduction capability information of each reproduction apparatus in response thereto (S4030). The process of transmitting and receiving the content information and the play command information is the same as described above and thus will be omitted.

In operation S4035, the virtual conversion apparatus 400 determines the priority of the content to be converted, the device to be converted, and the storage device. Then, the content to be converted is selected according to the priority (S4040).

The virtual conversion apparatus 400 may assign priority to each server device, and may select content of a server device having a high priority as priority content to be converted.

For example, the virtual conversion apparatus 400 receives content information from server devices connected to a network, and sets a highest priority value, for example, weight 3, for contents that cannot be played or smoothly played on a playback device. Can be assigned. In addition, the virtual conversion apparatus 400 may assign a second priority value, for example, weight 2, to contents that are not immediately playable in the playback apparatus and that are not playable even if converted. The virtual conversion apparatus 400 may assign a third priority value, for example, weight 1, to contents that are not immediately playable in the playback apparatus but are playable through the transformation. In addition, the virtual conversion apparatus 400 may assign a fourth priority value, for example, weight 0, to the contents that can be played back in the playback apparatus.

As such, the virtual conversion apparatus 400 may allocate a weight value for each content. In addition, the virtual conversion apparatus 400 may select target content to be converted based on the assigned weight value.

In addition, the virtual conversion apparatus 400 may determine the reproduction capability corresponding to each reproduction apparatus based on the above-described weight value and the reproduction capability information of each reproduction apparatus. For example, the virtual converter 400 may assign a weight value corresponding to each content for each playback device connected to the network. The virtual conversion apparatus 400 may select the content having the highest value as the content to be converted by summing the weight values for each playback device of each content. Accordingly, the virtual conversion apparatus 400 can efficiently select the content that needs the most conversion.

The virtual converter 400 may set a factor for a frequently used playback device. For example, the virtual converter 400 may allocate Factor 1 to 3 according to the frequency of use of the playback device. The virtual conversion apparatus 400 may multiply the assigned Factor value by the above-described weight values for each playback device, and add the sum values to determine the priority value of each content. The virtual conversion apparatus 400 may select the content to be converted in order of highest priority value. Accordingly, the virtual conversion apparatus 400 may preferentially select content to be reproduced in the playback apparatus most frequently used to improve user convenience.

When the target content is selected, the virtual conversion apparatus 400 requests the conversion information to all devices connected to the network in order to convert the target content (S4050), and collects the conversion information in response thereto (S4055). Since the conversion information request and collection process of the virtual conversion apparatus 400 is as described above, it will be omitted.

The virtual conversion apparatus 400 determines an output profile for the target content in operation S4057. The virtual converter 400 needs to set an output profile so that the playback device can play the target content smoothly. In addition, the virtual conversion apparatus 400 may set a plurality of output profiles for user convenience, and generate and store the converted content of various formats, various scales, various bit rates, and various rotation states in advance for the same content. . Therefore, when the user wants to play the content after performing the conversion in advance, the virtual conversion apparatus 400 may determine the optimal converted content for playback and display or recommend some of the converted content to the user. have. Therefore, the user can immediately watch the content properly converted in the playback device without additional conversion process.

To this end, the virtual transformation apparatus 400 may determine an output profile based on the collected transformation information.

For example, when content is selected according to the sum value X of the above-described weight values, the virtual conversion apparatus 400 based on each output profile, sums the sum values of the weight values when the selected content is converted to each output profile. We can calculate the calculated Y value and how much less it is than X. In addition, the virtual conversion apparatus 400 may determine the conversion to an output profile in the case where the largest Y value is large.

For example, when content is selected according to the value X2 obtained by multiplying the sum of the weight values by the frequency of use factor value, the virtual conversion apparatus 400 may select the selected content into each output profile based on each output profile. The sum of the weight values in the transformed case is calculated by multiplying the factor value by the factor value, and the Y2 value calculated by how much less than X2 can be obtained. The virtual conversion apparatus 400 may determine the conversion to an output profile in the case where the value of Y2 is the largest.

If the output profile is determined, the virtual conversion device 400 determines the device to perform the conversion (S4060).

The virtual transformation apparatus 400 may determine the apparatus to perform the transformation based on the transformation information collected above. For example, the virtual conversion apparatus 400 may determine the device having the highest conversion performance as the device to perform the conversion. In addition, the virtual conversion apparatus 400 may determine a server device having original content as a device to perform conversion. The virtual conversion apparatus 400 may determine a server device to store the converted content as a device to perform the conversion. According to the various methods of determining the conversion performing apparatus as described above, the virtual conversion apparatus 400 may provide efficient conversion performance according to a situation. Such a determination method may be predetermined by the user, or may be preset when designing a home network.

On the other hand, the virtual storage device 500 requests the storage information to each of the storage server devices connected to the network, and receives the storage information in response (S4065). The contents of the stored information and the request and reception process are the same as described above, and thus will be omitted.

When the device to be converted is determined, the virtual conversion device 400 requests the storage information from the virtual storage device 500 (S4070), and receives the storage information in response thereto (S4075). The virtual conversion apparatus 400 determines the storage device based on the storage information (S4080).

The virtual conversion apparatus 400 may perform the conversion in advance without a user request. Therefore, the virtual conversion device 400 needs to determine the storage device without a user selection input.

To this end, the virtual conversion apparatus 400 may determine the server device having the largest storage space as the storage device based on the received storage information. In addition, when there are a plurality of server devices having a difference in storage space within a predetermined size, the virtual conversion device 400 may determine a server device storing original content as a storage device, thereby minimizing network resource waste.

The virtual conversion apparatus 400 may determine a non-portable device as a storage device in consideration of user convenience according to whether the server device is portable. This is because a user often stores only essential content in a portable device. The virtual conversion apparatus 400 may obtain identification information of the server devices through the device discovery, and determine whether the portable device is portable based on the identification information. For example, the virtual conversion apparatus 400 may determine model names of server devices through device discovery, and determine whether the model is portable by comparing the portable model table with previously stored models.

Meanwhile, when determining the storage device, the virtual conversion device 400 may determine whether to store the converted content as new content according to its own file name assignment rule. In contrast, the virtual conversion apparatus 400 may determine whether to store the converted content as an additional resource corresponding to the original content object.

If the storage device is determined, the virtual conversion device 400 transmits a conversion start request to a device to perform conversion (S4085). The conversion start request can be sent in advance without user input. The conversion start request message may include, as input variables, identification information of the target content, location information of the target content, input profile information, output profile information, identification information of the storage device, and storage location information. The virtual conversion apparatus 400 may generate a conversion start request message according to the results of S4035, S4040, S4057, S4060, and S4080 described above, and transmit the converted start request message to the device to perform the conversion.

15 illustrates a case in which the DMS2 720 is both a device to be converted and a storage device. Accordingly, the DMS2 720, which is a device to be converted, performs the conversion according to the conversion start request message in operation S4090 and stores the converted content in a storage location of the DMS2 720 in operation S4095.

As such, the virtual conversion apparatus 400 may perform the conversion in advance without a user request to distribute the load of the network, and may improve convenience when a user wants to play content.

FIG. 16 illustrates a case in which the DMS2 720 is determined as a device to perform the conversion in advance, and the DMS1 710 is determined as the storage device.

First, as described above, the virtual conversion device 400 receives information from other devices and determines a device and a storage device to be converted (S4100). In operation S4110, a conversion start request is transmitted to the DMS2 720.

The DMS2 720 performs the conversion according to the conversion request message (S4120), and transmits the converted content file to the DMS1 710, which is a storage device (S4130). Accordingly, the DMS1 710 stores the received file and completes storing the converted content file (S4140).

FIG. 17 illustrates a case in which the DMS1 710 is determined as a device and a storage device to perform conversion in advance.

First, as described above, the virtual conversion device 400 receives information from other devices and determines a device and a storage device to be converted (S4200). Then, the conversion start request is transmitted to the DMS1 710 (S4210).

The DMS1 710 performs a conversion according to the conversion request message (S4220), and stores the converted content file (S4230).

FIG. 18 illustrates a case in which the DMS1 710 is determined as a device to perform the conversion and the DMS2 720 is determined as the storage device in advance.

First, as described above, the virtual conversion device 400 receives information from other devices and determines a device and a storage device to be converted (S4300). Then, the conversion start request is transmitted to the DMS1 710 (S4310).

The DMS1 710 performs the conversion according to the conversion request message (S4320), and transmits the converted content file to the storage location of the determined DMS2 720 to the storage device (S4330).

When the DMS2 720 receives the converted content file, the DMS2 720 performs storage (S4230).

19 is a flowchart illustrating a method of operating a virtual transformation apparatus 400 that performs transformation in advance according to an embodiment of the present invention.

In FIG. 19, it is assumed that content selected by the user for playback is not playable. First, the virtual conversion apparatus 400 determines whether there is content previously converted for content that cannot be played back (S4400). When there is no pre-converted content, the virtual conversion apparatus 400 may perform the conversion as described above.

However, if the converted content exists in advance, information about the converted content is displayed to the user (S4410). Here, the virtual conversion apparatus 400 may display a profile information list of the converted contents. In addition, the virtual conversion apparatus 400 may determine the content converted to be suitable for the playback device to be played by the user and recommend the content to the user.

In operation S4420, the virtual conversion apparatus 400 receives a selection input of content to be reproduced among the converted content from the user. The virtual conversion apparatus 400 controls the server apparatus to stream the converted content corresponding to the selection input to the playback apparatus, and controls the playback apparatus to play the streamed content (S4430). Accordingly, even in the case of the content that cannot be reproduced by the playback device, the virtual conversion device 400 can inform the user of the pre-converted content, and induce proper selection of the user to enable smooth content playback.

20 to 26 are diagrams illustrating a user interface output according to a content conversion method according to an embodiment of the present invention.

As shown in FIG. 20, the virtual conversion apparatus 400 or the control point apparatus 100 displays a list of contents included in each server device through a user interface based on the content information, and selects content through the user interface. An input can be received.

FIG. 21 illustrates a query interface indicating whether to convert selected content when a playback device cannot reproduce the content according to an embodiment of the present invention. As illustrated in FIG. 21, the virtual conversion apparatus 400 or the control point apparatus 100 may determine whether the playback apparatus can play the selected content based on the playback capability information. In addition, the virtual transformation apparatus 400 or the control point apparatus 100 may receive a transformation input through a query interface, and perform the transformation accordingly.

22 illustrates a storage interface according to an embodiment of the present invention. As illustrated in FIG. 22, the virtual conversion apparatus 400 or the control point apparatus 100 may display a storage interface for querying whether to store content to be converted and receive a user input thereto. The user can select either save, no save or alternate save via the storage interface. In addition, the virtual conversion apparatus 400 or the control point apparatus 100 may display a device to be converted to the user. 22 shows that the device to be converted is determined to be Device2.

23 shows a device selection interface when the user selects save. As shown in FIG. 23, the virtual conversion apparatus 400 or the control point apparatus 100 displays available storage spaces based on the storage information received from the virtual storage apparatus 500, and stores which device to store. The device selection input may be received from the user through the storage device selection interface. In addition, when the user inputs the automatic selection, the virtual conversion apparatus 400 or the control point apparatus 100 may select the storage device by itself through the above-described method.

24 illustrates a playback screen in the media renderer when the conversion is performed. The virtual conversion apparatus 400 or the control point apparatus 100 may receive the conversion progress information and transmit the converted progress information to the media renderer, and the media renderer may display the conversion progress status on the playback screen based on this. In addition, the server device that performs the converted content streaming may collect such conversion progress information and insert it into the streamed content. In FIG. 24, the conversion from the MP4 format to the WMV is performed in Device 1, and the storage in Device 2 is 80% in progress.

25 illustrates a converted content selection interface when conversion is performed in advance. The virtual conversion apparatus 400 or the control point apparatus 100 may not play the current content, but if there are a plurality of pre-converted contents, the virtual transformation apparatus 400 or the control point apparatus 100 may display the converted content selection interface for selecting any one of them. .

For example, as illustrated in FIG. 25, Content2 may be converted into three types: MP4, high definition version of 720p, medium definition version of AVI 480p, and WMV, low definition version of 240p. The user can select a desired version of the converted content. In addition, as shown in FIG. 25, the virtual conversion apparatus 400 or the control point apparatus 100 may determine and recommend an optimal version that can be smoothly reproduced by the reproducing apparatus. In Fig. 25, it is determined that the playback device is a high performance device, and that MP4 and 720p versions are recommended.

For convenience of description, the control point device 100 will be described with reference to FIG. 26. However, the block diagram of FIG. 26 may be applied to the media server 200, the media renderer 300, the DMS, or the DMR, which are control target devices. In addition, for convenience of description, the control point device 100 and the control target device may be represented by a terminal.

The control point device 100 may include a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 26 are not essential, so that a control point device having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the control point device 100 and the wireless communication system or between the control point device 100 and the network in which the control point device 100 is located. . For example, the wireless communication unit 110 may include one or more broadcast receiving modules 111, one or more mobile communication modules 112, one or more wireless Internet modules 113, one or more local area communication modules 114, and one or more location information. Module 115, and the like.

The terminal can connect to the network through this communication module.

In particular, in the embodiment of the present invention, the wireless communication unit 110 may transmit or receive the above-described message or device information through multicast or unicast under the control of the controller 180. The collected device information is stored in the memory 160.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and may be embedded or external to the control point device 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for obtaining a location of a terminal, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 26, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 may determine the current state of the control point device 100 such as an open / closed state of the control point device 100, a position of the control point device 100, presence or absence of user contact, orientation of the terminal, acceleration / deceleration of the terminal, and the like. The sensing unit generates a sensing signal for controlling the operation of the control point device 100. For example, when the control point device 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays (outputs) information processed by the control point apparatus 100. For example, when the terminal is in a call mode, the terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the control point device 100 is in a video call mode or a shooting mode, the control point device 100 displays a captured image and / or a received image, a UI, or a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

According to an embodiment of the control point device 100, two or more display units 151 may exist. For example, a plurality of display units may be spaced apart or integrally disposed on one surface of the control point device 100, or may be disposed on different surfaces.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 26, a proximity sensor 141 may be disposed in an inner region of the terminal surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 may also output a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the control point device 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the control point device 100. Examples of events occurring in the terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various haptic effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of the electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the terminal.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The control point device 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the control point device 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the control point device 100, or transmits data inside the control point device 100 to an external device. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the use authority of the control point device 100. The identification module includes a user identification module (UIM), a subscriber identity module (SIM), and a universal user authentication module. (Universal Subscriber Identity Module, USIM) and the like. A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device can be connected to the terminal through the port.

The interface unit may be a passage through which power from the cradle is supplied to the terminal when the terminal is connected to an external cradle, or a passage through which various command signals input from the cradle by a user are transmitted to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the terminal is correctly mounted in the cradle.

The controller 180 typically controls the overall operation of the terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

In particular, the controller 180 performs the determination and determination described with reference to FIGS. 2 to 20. That is, the controller 180 may perform each step shown in FIGS. 2 to 20 while controlling the wireless communication unit 110.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. These may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

According to an embodiment of the present invention, the above-described method may be implemented as code that can be read by a processor in a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

Claims

A method of providing a content conversion service by a control device using a control target device, the method comprising:

Discovering control target devices connected to a home network;

Selecting one of contents included in the server apparatus based on content information received from at least one server apparatus among the discovered apparatuses;

Determining whether the renderer can play the selected content based on protocol information received from at least one renderer of the discovered devices and the content information; And

Requesting to start conversion of the selected content to any one of the discovered devices if it cannot be played back;

Method of content conversion of the control device.
The method of claim 1,

Requesting the renderer to play the converted content.

Method of content conversion of the control device.
The method of claim 1,

The selecting step,

Displaying a list of server devices connected to the home network;

Selecting one server device from the server device list;

Receiving content information from the selected server device;

Displaying a content list of the selected server device based on the content information; And

Selecting content based on a user selection input for the displayed content list;

Method of content conversion of the control device.
The method of claim 1,

The conversion start message includes at least one of identification information, input profile information, and output profile information of the selected content.

Method of content conversion of the control device.
The method of claim 1,

The requesting to start the conversion may include:

Requesting conversion capability information from the discovered devices;

Receiving conversion capability information of each device in response to the request;

Determining a device to perform conversion based on the received conversion capability information, and generating a conversion start message; And

Transmitting the generated conversion start message to the device to perform the conversion.

Method of content conversion of the control device.
The method of claim 5,

Determining a device to perform the conversion, and generating a conversion start message,

Determining conversion performance of each device based on the conversion capability information and the content information; And

Determining a device to perform the conversion according to the conversion performance;

Method of content conversion of the control device.
The method of claim 5,

Determining a device to perform the conversion, and generating a conversion start message,

Determining a server device having the selected content as a device to be converted;

Method of content conversion of the control device.
The method of claim 1,

Requesting the conversion progress status to the device requesting the conversion start;

Receiving a conversion progress status in response to the conversion progress status request from the device requesting the conversion start; And

Outputting the received conversion progress;

Method of content conversion of the control device.
The method of claim 1,

Querying whether to store the converted content; And

And performing a store or replace storage operation according to the query result.
The method of claim 9,

The performing of the storing operation may include:

Receiving storage information from server devices among the discovered devices; And

Selecting a storage device to store the selected content based on the storage information;

The request for starting to convert the selected content may include

Generating a conversion start request message including identification information and storage location information of the storage device; And

Transmitting the conversion start request message to a device to perform conversion;

Method of content conversion of the control device.
In the content conversion method of the control target device,

Transmitting at least one of content information and storage information to the virtual server device according to a request of the virtual server device;

Transmitting conversion capability information to the virtual conversion device according to a request of the virtual conversion device;

Receiving a conversion start request message from the virtual conversion device; And

Converting a profile of specific content on a network based on the conversion start request message;

Method of content conversion of the control target device.
The method of claim 11,

The conversion start request message includes location information, input profile information, and output profile information of the specific content.

The converting step

Receiving the content from a server device holding the content over a network based on the location information of the content; And

Converting the received content into an output profile based on the conversion start request message;

Method of content conversion of the control target device.
The method of claim 11,

The conversion start request message further includes storage device information to store the specific content,

Transmitting the converted content to a storage device connected to a network based on the storage device information.

Method of content conversion of the control target device.
The method of claim 11,

Receiving a streaming request from a playback device connected to a network; And

The method may further include streaming the converted content to the playback device according to the streaming request.

Method of content conversion of the control target device.
In the control device,

A communication module for searching for control target devices connected to a home network and performing communication with the discovered control target devices; And

Protocol information received from a renderer to select one of contents included in the server apparatus based on content information received from at least one server apparatus among the discovered apparatuses, and to play the content among the discovered apparatuses And a control unit for determining whether the renderer can play the selected content based on the content information, and requesting any one of the searched devices to start converting the selected content through the communication module if it is impossible to play the selected content. Containing

controller.
The method of claim 15,

The control unit

Transmitting network connection setting information for receiving the converted content to the renderer through the communication module, and requesting the renderer to play the converted content.

controller.
The method of claim 15,

A display unit configured to display a server device list connected to the home network and a content list of the server device; And

The apparatus may further include a user interface unit configured to receive a server device selection input from the server device list and a selection input of content included in the selected server device.

controller.
The method of claim 15,

The communication module further receives conversion capability information from the discovered devices,

The controller selects content to be converted in advance according to a priority value determined based on the conversion capability information and the content information.

controller.
The method of claim 18,

The control unit generates a plurality of conversion start request messages to correspond to a plurality of different output profiles for the content to be pre-converted, and receives a plurality of different output profiles through the display unit when receiving a reproduction command of the pre-converted content. Indicating that this exists

controller.
In the control target device,

A communication module for transmitting at least one of content information and storage information to the virtual server device according to a request of a virtual server device, and transmitting conversion capability information to the virtual conversion device according to a request of the virtual conversion device; And

A control unit for converting a profile of a specific content on a network based on the conversion start request message when receiving a conversion start request message from the virtual conversion device through the communication module,

The controller is configured to stream the converted content through the communication module in response to a streaming request from a playback device connected to the network.

Control target device.