KR100735971B1 - Remote user interface display control method for home network - Google Patents

Abstract

A method for remotely controlling a screen image in a home network is provided to reduce load of a network by allowing a client device having low performance to implement a fast screen user interface processing function. A media server creates a document requesting generation of an object in the form corresponding to image data as an XML(eXtensible Markup Language) document in which attribute values, requesting generation of a particular color and a particular pattern corresponding a background image of image data and generation of a rectangular object in the form corresponding to a frame image of the image data, are written, and transmits it to a client device. The client device draws an object according to contents of the object generation request document, and displays it on a screen.

Description

Remote screen control method on home network {REMOTE USER INTERFACE DISPLAY CONTROL METHOD FOR HOME NETWORK}

1 is a diagram showing the configuration of a typical UPnP AV home network;

2 is a view showing a functional configuration of a conventional media server;

3 is a diagram illustrating a functional configuration of a media server of a UPnP AV home network to which a remote screen control method of the present invention is applied;

4 is a view showing a document in XML format for requesting object generation to generate an image according to the present invention;

5 is a diagram exemplarily illustrating a mapping between an image and object data for generating the image.

<Description of the symbols for the main parts of the drawings>

10: media server, 20: control point,

30: media renderer, 40: user interface generation unit,

42: image buffer, 44: encoder,

46: protocol processing section, 48: object processing section.

The present invention relates to a remote screen control method for displaying an image in a Universal Plug and Play (UPnP) AV home network.

In general, the UPnP home network is composed of a control point (CP) for controlling a device and devices for providing a service, and the control point (CP) finds various devices through a provided interface. (Discovery, Description), control, and receive and process events.

As illustrated in FIG. 1, an AV device connected to a UPnP network includes a media server 10 that provides various media data, and a media renderer 30 that plays back the media data. The media server 10 and the media renderer 30 are controlled by a control point (CP) 20. In addition, the media server transmits the media data to the media renderer in a streaming manner based on various known transport protocols.

In FIG. 1, the control point 20 and the media renderer 30 may function as physically independent devices, but may also coexist physically in one client device.

On the other hand, the UPnP standard has a standard protocol called Remote User Interface (RemoteUI), which is used between a media server and a client device (ie, a device in which a control point and a media renderer coexist) or a media renderer. After exchanging capabilities of each other, the image buffering data is transmitted from the media server using a protocol for media streaming, and the client device, for example, the media renderer, decodes the image buffering data to display a screen for the user interface (UI). To display it.

This remote user interface allows the client device, e.g., the media renderer, to simply utilize the image buffering data by application manipulation on the media server without implementing a separate user interface or application. The image can be displayed on the screen.

As shown in FIG. 2, the media server includes a user interface generator 40 for generating image data as frame data for a user interface, an image buffer 42 for buffering the image data, and buffered image data. It includes an encoder 44 for encoding the protocol processing unit 46 for transmitting the encoded image data to the client device using a protocol for media streaming.

When the media server calculates in advance the screen size to be displayed on the client device by the user interface generation unit 40 and draws it in the image buffer 42, the media server encodes the image data in a specific image format by using the encoder 44. It is adapted to transmit to the client device via the protocol processing section 46.

When the remote user interface is used, the function of the media server is complicated, but the function of the client device is simplified. If the client device or the media renderer implements only a control method with the media server, a separate method for image processing is performed. Even if the application is not implemented, the image processing is performed at the media server. Therefore, simply receiving the image from the server and decoding the image and displaying the image on the screen constitutes a screen for the user interface.

However, such a client device has been simplified in its function by the role of a media server. However, in a client device whose image decoding operation is below a certain level, the remote user interface method through the image buffer is not performed. In the case of conventional image data such as BMP and BMP, decoding is possible. However, when encoding and transmitting image data in which a complex digital data compression algorithm such as JPEG or PNG is implemented, the client device having low performance may be used. There is a problem that it is not easy to decode the corresponding image data.

In addition, when the client device has a small screen size, such as a portable device, there is a problem in that efficient decoding cannot be performed even when image buffered data from the media server is received due to the limitation of the screen size.

Accordingly, the present invention has been made in view of the above-described conventional situation, and an object thereof is to efficiently process a user by processing an image in an object drawing method in a media server for a remote user interface (RemoteUI) function in a UPnP AV home network. It is to provide a remote screen control method in a home network to enable an interface.

In order to achieve the above object, according to the present invention, a method for providing image data from a media server to a client device in a remote user interface (RemoteUI) method in a home network, the object corresponding to the image data in the media server Creating a document requesting generation of the document; transmitting the object generation request document to the client device; and drawing an object according to contents of the object generation request document on the client device and displaying the object on the screen. A remote screen control method in a home network is provided.

Hereinafter, the present invention configured as described above will be described in detail with reference to the accompanying drawings.

3 is a diagram illustrating a functional configuration of a media server of a UPnP AV home network to which the remote screen control method of the present invention is applied.

As shown in FIG. 3, the media server of the UPnP AV home network includes a user interface generator 40 for generating image data as frame data for a user interface, and an image buffer 42 for buffering the image data. And an encoder 44 for encoding the buffered image data, and a protocol processor 46 for transmitting the encoded image data to the client device using a protocol for media streaming.

The media server is classified into a case of transmitting an image using a conventional image buffer method and an object drawing method of creating an object to be drawn corresponding to the shape of the image data according to the present invention.

In the case of the conventional image buffer method, the media server calculates the screen size to be displayed on the client device by the user interface generation unit 40 in advance and draws the image data in the image buffer 42 in the same manner as before. The encoder 44 is encoded in a specific image format and transmitted to the client device through the protocol processor 46.

In the present invention, the media server generates an object to be drawn corresponding to the shape of the image data generated by the user interface generation unit 40 to generate a client device (eg, a control point) through the protocol processing unit 46. And an object processing unit 48 for transmitting to a combo device or a media renderer where the media renderer coexists.

In the media server, a condition for drawing an object corresponding to the image data by the object processing unit 48 according to an object drawing method is to transmit data in an object drawing method rather than an image buffer method in a client device, for example, a combo device. This is limited to the case where the request is made, which is a case where the client device does not smoothly support decoding of various images in hardware, or when the image decoding time is long due to low performance of the system.

As illustrated in FIG. 4, the object processing unit 48 represents a document in XML (Extensible Markup Language) format that requests an object to be drawn to be reproduced in a client device or a media renderer so as to correspond to a particular type of image data. have.

The illustrated object generation request document may include a background color of an object displayed on a screen of a client device, a position, size, color, and font size of text written on the screen image of a frame image, Font color and text display position information are written.

In order to create an XML document for the object generation request, the object processing unit 48 prepares a generation rule of an object corresponding to each image in advance as illustrated in FIG. 5.

With respect to the background of the screen according to the corresponding rule of FIG. 5, in the conventional image buffer method, unlike the background of the image as it is, the object drawing method of the present invention is similar to the background of the image with respect to the background. A command is written 401 to instruct to fill the background background with a specific color or a specific pattern.

In the conventional image buffer method, a user interface frame drawn on the screen is similar to a user interface frame image in the object drawing method of the present invention, in contrast to drawing the frame image in the data buffer to fit the screen. Write a statement instructing to draw a rectangular object of the object (402).

With respect to text drawn on the screen, in the conventional image buffer method, unlike drawing an image of text on the image buffer so that the screen can be displayed on the screen, the object drawing method of the present invention gives a property of a text object and displays the text. Write a statement that instructs to draw according to the attribute value (403).

Meanwhile, in the present invention, the document in the form of XML requesting to draw an object image according to the object generation routine is transmitted as a request packet, but a desired object is displayed on the screen through a binary command definition. It is also possible to pass commands for implementation.

Therefore, in the combo device in which the client device, for example, the media renderer and the control point are combined, when the media server receives the object creation request document in XML format, the client device, for example, does not perform image decoding. Accordingly, the object can be drawn and displayed on the screen.

On the other hand, the present invention is not limited to the above-described typical preferred embodiments, but can be carried out in various ways without departing from the gist of the present invention in various ways, modifications, substitutions or additions in the art. Anyone with knowledge of the world can easily understand it. If the implementation by such improvement, change, replacement or addition falls within the scope of the appended claims, the technical idea should also be regarded as belonging to the present invention.

As described above, according to the present invention, in order to support display of an image for a low-performance client device in which hardware image decoding is not supported in the UPnP AV home network or decoding of various images is not smooth, drawing an object in a media server By providing a document requesting the creation of an object corresponding to the image to be displayed through the method, the client device can directly draw the object according to the object creation request document and display it on the screen, so even in a low performance client device The user interface processing function of the fast screen can be implemented, and the network load becomes relatively small.

Claims (6)

A method for providing image data from a media server in a home network to a client device in a remote user interface (RemoteUI) method, A rectangular object having a specific color corresponding to a background image of the image data, a specific pattern corresponding to a background image of the image data, and a frame image corresponding to the frame image of the image data may be generated by the media server. Creating an XML (Extensible Markup Language) document in which an attribute value requesting generation of the object is written and transmitting the same to an client device; And drawing an object according to the content of the object generation request document in the client device and displaying the object on a screen. delete delete The method of claim 1, The property value requesting the creation of the rectangular object is a remote screen control method in a home network, characterized in that the location, size, and color of the object are specified. The method of claim 1, And a property value of a text object corresponding to a text image is written in the object generation request document. The method of claim 5, The attribute value of the text object is a remote screen control method in a home network, characterized in that the font size, color, and text display position of the text are specified.

Images