KR100651200B1 - Apparatus and method for data broadcasting service in home network environment - Google Patents

Abstract

A data broadcasting service system in a home network environment and a data broadcasting service method using the same are provided to mix a graphic image and an audio/video stream from a data broadcasting receiver and to display the mixed data to a user. A broadcasting receiver(410) receives a data broadcasting signal. A home server(430) connects the broadcasting receiver and an information terminal(420) having a display function. An ACAP(Advanced Common Application Platform) manager(411) and an ACAP handler(421) for handling a data broadcasting signal are mounted to the broadcasting receiver and the information terminal. The ACAP manager receives the data broadcasting signal through a tuner, divides the signal into an A/V(Audio and Video) stream and application and transmits the divided A/V stream and application to the ACAP handler.

Description

Data broadcasting service system in home network environment and data broadcasting service method using same {Apparatus and Method for Data Broadcasting Service in Home Network Environment}

1 is a configuration diagram of an embodiment of a general terrestrial based data broadcasting service system.

2 is a diagram illustrating an embodiment of an operation process of a receiving terminal for a general data broadcasting service.

3A or 3B is a diagram illustrating an embodiment of a general data broadcasting service output screen.

4 is a block diagram of an embodiment of a data broadcasting service system in a home network environment according to the present invention;

5 is a diagram illustrating an embodiment of a data broadcasting service method in a home network environment according to the present invention;

* Explanation of symbols for the main parts of the drawings

410: broadcast receiver 411: ACAP manager

412: Video Manager 413: Graphic Manager

414: Event Manager 415: Transport Stream Buffer

416: frame buffer 417: event queue

420: information terminal 421: video handler

422 graphic handler 423 event handler

430: home server 431: service broker

440: AV Converter

The present invention provides a data broadcasting service system in a home network environment in which an information terminal interworking with a home network receives a data broadcasting service received through a terrestrial wave from a data broadcasting receiver and performs a data broadcasting service, and a data broadcasting service method using the same. More specifically, an information terminal interworking with a home network does not have a data broadcasting middleware like a data broadcasting receiver, but only a graphic processing capability and a video streaming capability to provide a data broadcasting service to a user at the same level as a data broadcasting receiver. A data broadcasting service system in a home network environment that can be provided, and a data broadcasting service method using the same.

The data broadcasting service is provided in the form of sending and receiving digital streams consisting of HD (High Density) class video and Java-based value-added information services to the viewers according to matching guidelines.

1 is a configuration diagram of an embodiment of a general terrestrial based data broadcasting service system.

As shown in FIG. 1, the data broadcasting service system includes a single program encoder (110) for receiving and encoding video, audio, and data signals, program designation information (PSI), and program and system protocol (PSIP). The PSI / PSIP Generator 120 generating the PSI / PSIP Generator 120, and the transport stream output from the Single-Program Encoder 110 and the PSI / PSIP Generator 120 are generated. A multi-program transport multiplexer (MP Transport Mux) 130 to multiplex, the channel coding and 8-VSB modulated channel coding (Coding) the multi-program transport stream output from the multi-program transport multiplexer (MP Transport Mux) 130 Channel coder and 8-VSB modulator 140, the transmitter (DTV Transmitter) 150 for transmitting the signal output from the channel coder and 8-VSB modulator (140), the To the DTV Transmitter 150 A tuner (DTV Tuner) 160 that selects a desired channel from the transmitted signal, a demodulator (8-VSB Demodulator) 170 that demodulates the signal of the channel selected by the tuner (DTV Tuner 160), and the demodulator 8 A transport demux 180 for demultiplexing the transport stream output from the VSB demodulator 170 and a single program decoder for decoding the data output from the transport demux 180 Program Decoder 190, and a Program Guide Database 197 for storing the program and system protocol (PSIP) data output from the transport demux (180).

The Single-Program Encoder 110 is an MPEG-2 Encoder 111 that encodes an input video signal into MPEG-2 data. An AC-3 encoder 112 for encoding an input audio signal into an AC-3 data format, and the MPEG-2 encoder 111 and the AC- encoder. A three encoder (AC-3 Encoder) 112 and a multiplexer (Transport Mux) 113 for receiving and multiplexing the data signal.

In addition, the single program decoder 190 may decode the MPEG-2 bit stream output from the transport demux 180. A display processor 192 for processing a video signal output from the MPEG-2 decoder 191 and the MPEG-2 decoder 191; An AC-3 decoder (193) for decoding an AC-3 (AC-3) bit stream output from a transport demux (180), and the demultiplexer (Transport Demux) (180) Restores the clock by referring to the Time Stamp and PCR (Program Clock Reference) included in the MPEG-2 bit stream and the AC-3 bit stream output from the Clock recovery and synchronization (194).

2 is a diagram for explaining an operation of a receiving terminal for a general data broadcasting service.

A general data broadcasting service is an audio / video (AV), additional information, and program designation information (hereinafter referred to as "PSI") through an audio / video (AV) content server, an application server, and a service information (SI) server. / Program and system protocol (hereinafter referred to as "PSIP") information is encoded into one MPEG-2 transport stream (TS) and then modulated by VSB or QAM to map to the channel. Is transmitted in the frequency band. After the viewer operates the data broadcasting receiver, the viewer selects a specific channel, and the tuner 210 receives and demodulates a broadcast signal of a frequency band mapped to the channel to demodulate the MPEG-2 transport stream (MEPG-2). TS). And, through the CAS (Conditional Access System) (CAS) 220 so that only the recipients who are eligible to receive the paid broadcasting service can receive the generated transport stream (TS) using the PSI / PSIP information, the audio / video ( Audio / Video (AV) information is separated from Demux (230) by AV) and additional information, and the media / decoder (240) such as software or digital TV (DTV) video decoder (Decoder) and audio decoder (Decoder). The additional information is decoded through the ACAP (Advanced Common Application Platform: hereinafter referred to as "ACAP") middleware, analyzed by the Java application (Application) is configured by the Java virtual machine according to the user's choice. Here, a user interface of a Java application is drawn on a graphic device called a frame buffer, and a video screen of an audio / video AV is drawn on a video device.

3A or 3B is an exemplary diagram illustrating a general data broadcasting service output screen.

FIG. 3A illustrates a graphic reference model of a broadcast receiving terminal, which is divided into a background plan 301, a video plan 302, and a graphic plan 303.

First, the background plan 301 is a screen that is basically displayed when nothing appears on the TV screen, and the video plan 302 is a video screen of a broadcast, and the screen size or position on the screen may be changed. . In addition, the graphic plan 303 may be overlaid on the video plan as the user interface (UI) of the application comes out, and the transparency may be adjusted in units of pixels.

That is, the graphic plan 303 and the video plan 302 are overlaid and composed of one display as shown in FIG. 3A and shown to the viewer.

Figure 3b shows the screen shown in real life and the screen shown in the data broadcasting standard application program interface (API).

In FIG. 3B, "JMF Video Component" 311 and "HGraphicsDevice" 312 are classes defined in data broadcasting, which correspond to a graphical user interface, and "HVideoDevice" 313 identifies a video plan 302 in data broadcasting. It is a class defined for controlling, and "HBackgroundDevice" 314 is a class defined for controlling the background plan 301 which is a wallpaper.

For reference, the screen drawn on the video plan 302 stores information in a memory allocated as a video buffer, and the screen drawn on the graphic plan 303 stores information in a frame buffer. do. In this case, the information stored in the frame buffer includes an alpha value for adjusting transparency.

On the other hand, the viewer can operate the Java application at a desired point of time through the remote control, the user interface is changed in the process of performing the application in accordance with the input, which is again a frame After being drawn in the frame (Frame Buffer), it is combined with the video screen to be transferred to the display device.

In the home network environment, home appliances are connected by various media such as power lines, IEEE 1394, USB (Universal Serial Bus), Ethernet, Ethernet, and wireless LAN. In addition, a control device that provides only a passive device according to its performance and a list of home appliances on the home network, and a control device capable of providing a service by controlling a specific home appliance according to a user's input ( Controller Device).

Controller Device and Controlled Device should be equipped with middleware for home network service, Home Audio / Video interoperability (HAVi), Universal Plug and Play (UPnP), Java Intelligent Network Infra- various standards exist.

Generally, these middlewares are composed of components such as lookup / discovery for finding each device, resource manager for resource management, messaging system for message delivery, and registry for managing services provided by each device.

In order to receive home network service, a user can search a list of all home appliances using a home network terminal having a display capability, and select a home appliance through an input device such as a remote controller or a keyboard to receive a service. The user interface can be performed.

In general, a device that a user can utilize as a controller device may include a TV, a personal digital assistant (PDA), a set-top box, and a personal computer (PC).

On the other hand, in order to perform the data broadcasting service performed by the data broadcasting receiver in another terminal in the home network environment as described above, the two terminals must be aware of each other and perform transmission / reception matching of control commands or data for service execution. The protocol must be supported in common. However, the conventional method has a problem in that it is not possible to receive a service from another terminal in real time by receiving data from a receiving terminal, storing the data in a database, and then transmitting the data to another terminal.

The present invention has been proposed to solve the above problems, and the information terminal interworking with the home network does not have the data broadcasting middleware like the data broadcasting receiver, and has only the graphic processing capability and the video streaming capability. A data broadcasting service system in a home network environment capable of receiving a combination of audio / video (AV) streams to be shown to a user and delivering a user's input to a data broadcasting receiver to perform a data broadcasting service, and a data broadcasting service method using the same The purpose is to provide.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

An apparatus of the present invention for achieving the above object is, in a data broadcasting service system in a home network environment, receiving a data broadcasting signal and separating it into a transport stream and an application (Data) for data broadcasting handling means for data broadcasting Management means; The data broadcasting handling means for combining the transport stream and application information received from the data broadcasting managing means to the user, receiving the event input by the user, and transmitting the received event to the data broadcasting managing means; Service relay means for recognizing the data broadcast management means and the data broadcast handling means with each other by a predetermined protocol so as to exchange necessary messages; And converting means for converting media in order to match media compatibility between the data broadcasting managing means and the data broadcasting handling means.

On the other hand, the method of the present invention, in the data broadcasting service method in a home network environment, after the ACAP manager and the ACAP handler is connected, the compatibility determination step of exchanging information to determine the compatibility for video streaming; As a result of the determination of the compatibility determination step, if compatible, the video manager and the video handler are connected for video streaming, the graphics manager and the graphics handler are connected, and the event manager and the event handler are connected to initialize the ACAP service to be retransmitted. An initialization task performing step of performing a task; As a result of the determination of the compatibility determination step, if compatibility is not achieved, find an AV converter service serving as a connection between the ACAP manager and the ACAP handler, check the media conversion function, and convert the media to the information terminal, A media conversion step of proceeding to performing the initialization operation; And retransmitting the data broadcast service for retransmitting the data broadcast service after setting a path between the ACAP manager and the ACAP handler.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

4 is a configuration diagram of an embodiment of a data broadcasting service system in a home network environment according to the present invention.

The data broadcasting service system according to the present invention includes a broadcast receiver 410 for receiving a data broadcast signal, an information terminal 420 having a display capability, and a home connecting the broadcast receiver 410 and the information terminal 420. Server 430. Looking at this in more detail, the data broadcasting service system according to the present invention, the ACAP manager 411 that receives the data broadcast signal, separates the transport stream and the application (Application) and delivers to the ACAP handler 421 of the information terminal 420 ACAP handler 421 which combines the transport stream and application information received from the ACAP manager 411 to the user and receives an event input by the user and delivers it to the ACAP manager 411. Recognizing the ACAP manager 411 and the ACAP handler 422 with each other by a corresponding protocol, a service broker 431 for sending and receiving a required message, and the ACAP manager 411 and the ACAP handler And an AV converter 440 for converting media to match compatibility between the 422.

The ACAP manager 411 includes a video manager 412 managing video data, a graphic manager 413 managing graphic data, an event manager 414 managing event data, and a transport stream buffer 415 storing a transport stream. ), A frame buffer 416 for storing graphic information, and an event queue 417 for storing event information.

The ACAP handler 421 handles a video signal and displays a video handler 422 for displaying the received video streaming on the screen, a graphic handler 423 for handling a graphic signal and superimposing the received image on the video screen, and an event signal. It includes an event handler 424 that handles and delivers a user input keyboard or mouse event to the ACAP manager 411.

Standards for interworking with home networks include de facto standards such as Home Audio / Video interoperability (HAVi), Universal Plug and Play (UPnP), Java Intelligent Network Infrastructure (Jini), and Universal Middleware Bridge (UMB). The present invention uses an integrated middleware technology called a UMB (Universal Middleware Bridge: UMB) as a protocol for configuring and controlling the broadcast receiver 410 and the information terminal 420 as a home network. However, the present invention is not limited to the above UMB technology.

 On the other hand, the data broadcasting service system according to the present invention proposes to perform the data broadcasting service received by the broadcast receiver 410 in the information terminal 420 is to provide the following components to expand.

As shown in FIG. 4, the broadcast receiver 410 and the information terminal 420 are equipped with an ACAP manager 411 and an ACAP handler 421 for handling data broadcast signals, respectively.

The ACAP manager 411 of the broadcast receiver 410 receives a data broadcast signal through a tuner, divides it into an audio / video (AV) stream and an application, and delivers the data to the ACAP handler 421 of the information terminal 420. It plays a role.

The ACAP handler 421 of the information terminal 420 combines the received audio / video (AV) stream with the application information to the user and shows the user and receives the key input by the user to the ACAP manager 411. It plays a role.

The configuration of the ACAP manager 411 and the ACAP handler 421 is as follows.

The ACAP manager 411 reads the broadcast stream from the transport stream buffer (TS Buffer) 415, which is a memory buffer, and transmits the video stream to the information terminal 420 through a communication protocol such as HTTP or RTP. When the analysis is performed and an application is executed, a graphic manager 413 and the information terminal 420 which draw a user interface in a frame buffer d and capture it as an image and transmit it to the information terminal 420. The event manager 414 includes a keyboard or mouse event received from the event queue and requests a locally executed application to process.

The ACAP manager 411 and the ACAP handler 421 may be registered as a UMB service and may recognize each other from the service blocker 431 of the home server 430 by the lookup protocol of the UMB, and may exchange necessary messages.

Meanwhile, the graphic manager 413 captures a graphic screen shown by a programming guide, a TV menu, or the like when an application is included in the data broadcasting stream or by a user's request, and transmits the graphic screen to the graphic handler 423. do. To this end, the ACAP manager 411 finds the ACAP handler 421 and prepares for operation by exchanging graphic resolution and supporting image format information.

The event manager 414 and the event handler 424 operate to exchange user input information. The event manager 414 and the event handler 424 are connected after the compatibility check and connection for the audio / video (AV) stream and the graphic image are made.

5 is a diagram illustrating an embodiment of a data broadcasting service method in a home network environment according to the present invention.

As shown in FIG. 5, in the data broadcasting service method according to the present invention, first, after the ACAP manager 411 and the ACAP handler 421 are connected 501, information is exchanged to determine compatibility for video streaming. (502). If compatible, the video manager 412 and video handler 422 are connected for video streaming, the graphics manager 413 and graphics handler 423 are connected, and the event manager 414 and event handler 424 are connected. In operation 503, an initialization operation may be performed so that the ACAP service may be retransmitted.

If compatibility is not achieved, the device checks whether there is a device that can act as a connection between the ACAP manager 411 and the ACAP handler 421. This also uses the lookup protocol of the UMB to find the AV Converter (AV Converter) service, and check the media conversion function, converts the media and transmits to the information terminal 420 (504), performing the initialization operation Proceed to step 503.

Subsequently, after setting the path, the data broadcasting service is retransmitted (505).

For example, if the information terminal 420 on which the ACAP handler 421 operates is capable of decoding MPEG-4, the MPEG-2 transport stream (TS) format may be used. Passing ACAP audio / video (AV) directly has no meaning. Accordingly, if the audio / video AV converter 440 can convert the MPEG-2 transport stream TS to MPEG-4, the information terminal 420 converts the intermediate to real time. It is configured to serve as a). In this situation, the ACAP manager 411 informs the audio / video AV converter 440 of the ACAP handler 421's video address, and thus the ACAP manager 411's video manager for the audio / video (AV) stream. 412, the AV converter 440, and the video handler 422 of the ACAP handler 421 are set.

Meanwhile, as information exchanged between the ACAP manager 411 and the ACAP handler 421 to check an audio / video (AV) stream or graphic capability, metadata is defined in the following form.

First, "SERVICE_TYPE" defines service types such as audio / video (AV) and image, and "FORMAT" means MPEG-2 transport stream (TS) and MPEG-4 (MPEG-4). ), H.264, WMV9, JPG, PnP, GIF, BMP, etc., "TRANSPORT" is defined for RTP, HTTP, etc., "RESOLUTION" is 1920x1024i, 960x540p, 720x540p, 640x480p, 1024x768 , 960x540, 640x480 and so on.

In more detail with respect to the meta data, the service type (SERVICE_TYPE) is for distinguishing whether it is an audio / video (AV) stream or information for graphic image processing, and the format (FORMAT) is encoding of content. Information about the method. If more than one is supported, all are separated by "commas". Transport refers to a transport protocol, and examples thereof include RTP, HTTP, TCP / IP, and IEEE1394. RESOLUTION information refers to a resolution that can be supported by a target device, and is used to determine when a format converter or a scale is required.

The meta data is requested by the ACAP manager 411 after finding the ACAP handler 421 and analyzed by the ACAP handler 421. If compatible information is included, the best resolution is selected and interworking. Otherwise, the AV Converter 440 is searched and the ACAP handler 421 supports the real-time audio / video (AV) format. You will find a device that supports the conversion. If present, it connects to an AV converter 440 and requests to connect an AV converter 440 to an audio / video (AV) handler. If the AV converter 440 supporting the real-time conversion is not found, the audio / video (AV) manager and the audio / video (AV) handler interworking have failed and transmit an event.

Meanwhile, the data broadcasting service method according to the present invention includes a retransmission method of an audio / video (AV) stream, an application retransmission method, and a user input processing method.

First, an audio / video (AV) stream retransmission method is as follows.

The broadcast receiver 410 analyzes the MPEG-2 transport stream TS, which is a digital broadcast transport stream received from the tuner, and the audio / video AV is a demultiplexer of the DTV chipset. Demux) and decoder to output to the screen and speakers.

The MPEG-2 transport stream TS coming from the tuner may be buffered into the transport stream buffer 415 immediately before going to the demultiplexer Demux. The AV converter 440 or the video handler 422 can select a transmission protocol such as "HTTP" or "RTP" and transmit the same in real time.

If there is no ability to analyze the MPEG-2 transport stream (TS) in the information terminal 420 and has other audio / video (AV) decoding functions, the MPEG-2 transport stream. The TS is transmitted to the AV converter 440 through a "HTTP" or "RTP" transmission protocol, and after the real-time format conversion in the AV converter 440, the video handler 422 Resend to. In this case, the connection path is established by checking the transmission time and the format conversion time to see if streaming can be performed in real time without interruption.

Termination of streaming may occur by requesting a STOP on the information terminal 420 side or by lack of resources. In this case, a system event is generated through the event manager 414 and the event handler 424. These events are "RESOURCE_OUT", "STOP", "PAUSE", "RESUME", and so on.

The video handler 422 receives audio / video (AV) streams from the AV converter 440 or the video manager 412 and inputs them to the video encoder of the information terminal 420. When interworking with the video manager 412, it is necessary to search for and inform the video format, resolution, and transport protocol information supported by the system information.

Next, the application retransmission method is as follows.

Application of data broadcasting is in the form of Java program. It is classified into a data block called DSM-CC (Digital Storage Media Command and Control) through the demultiplexer (Demux) in the MPEG-2 transport stream (TS) and then transmitted to the application transmitted by the broadcasting company. This is how it is done after it is created. Accordingly, in order to execute a Java program, an engine for filtering an application from an MPEG-2 transport stream TS and an API (Application Program Interface) for executing a Java program are supported. JAVA Runtime Environment) and DTV standard package should be provided. The structure for the user to react while watching the screen on which the application is executed in the information terminal 420 without such an environment is as follows.

An actual application is performed in the broadcast receiver 410, and the graphic screen is captured as an image and transmitted to the information terminal 420 using a communication protocol.

The information terminal 420 configures and displays the received screen image to overlap with the video screen. Of course, the size of the video screen and the graphic image have the same value, and the transparency should be adjusted by alpha blending. The alpha blending function is determined by the graphics system of the information terminal 420, and if not supported, only one of the video or the graphic screen is displayed.

The graphic manager 413 of the ACAP manager 411 and the graphic handler 423 of the ACAP handler 421 perform a retransmission related operation of the application.

The graphic manager 413 monitors the frame buffer 416 of the broadcast receiver 410 to monitor whether the screen of the application is changed.

The frame buffer 416 is a graphic area required for drawing an application screen and is generally used as an area where a root window of an ACAP application is drawn. Therefore, when the screen of the ACAP application is changed even a little, the contents of the frame buffer 416 may be changed.

If the graphic manager 413 detects a change in the frame buffer 416, the graphic manager 413 captures a frame area as an image, and then transmits the information to the graphic handler 423. Convert the image size to match the resolution and send. In addition, if the information terminal 420 can process an alpha blending support image format such as PNG (Portable Network Graphics) in order to prevent waste of network resources, the information terminal 420 converts the format and transmits the converted format.

When the graphic handler 423 is connected to the graphic manager 413, the graphic handler 423 transmits its resolution and a supported image format to process a basic procedure for performing an application. After receiving an image transmitted from the graphic manager 413, the image is converted into a BMP image and overlaid on the video screen.

Depending on the network status or the format and size of the image to be transmitted, the speed at which the Java application is viewed by the information terminal 420 is different, so it is much slower than the appearance of the local receiver broadcast receiver 410. Even if the ACAP middleware is not included in its entirety, the data transmission application can be executed in a stable manner.

Meanwhile, the user input processing method is as follows.

The ACAP application is executed in the form of receiving a user's input through a remote controller or a keyboard, performing a corresponding operation, changing a screen, and waiting for another input.

When the application is operated in the information terminal 420 is also presented in a method for receiving a user input, which should occur at the same level as that made in the broadcast receiver 410.

Even after the screen on which the application is performed is captured as an image and transmitted to the information terminal 420 to show only the image, the user wants to input a desired input into an input device such as a keyboard or a stylus pen of the information terminal 420. .

In the present invention, the information terminal 420 supports the same operation as the direct input from the broadcast receiver 410. That is, the event handler 424 intercepts an event generated when the user inputs a device such as a keyboard, a stylus pen, or a mouse. In general, when a keyboard is input, a key event and a value indicating whether the key is pressed are combined to generate one keyboard event. In the case of a mouse, a mouse event is generated by combining the positions and positions of the left and right buttons of the mouse. The stylus pen generates mouse events just like a mouse. Accordingly, the event handler 424 monitors the generated keyboard and mouse events and delivers them to the event manager 414 as follows.

Keyboard and mouse events generated on the screen of the graphic handler 423 are registered to be processed in the event handler 424. The event handling routine of the event handler 424 analyzes the type of the event and transmits to the event manager 414 a combination of "(KEYBOARD, key code value, PRESSED_KEY)" in the case of a keyboard event. In the case of a mouse event, the event is sent to the event manager 414 in combination with " (MOUSE, x, y, PRESSED) ". Where x and y describe where the mouse event occurred.

In Java programs, keyboard events and mouse events are only handled by the specific component that has input focus. Accordingly, event manager 414 must find the component that has input focus to process the event sent from event handler 424.

If the received event is a keyboard event, the event manager 414 obtains a reference of the root window of the currently executing Java program, finds the focused component, and generates a keyboard input event.

Since the EventManager class of ACAP middleware manages the events that occur in ACAP application, when the keyboard event is delivered to the EventManager class, the event occurs immediately to the component with input focus. If the received event is a mouse event, some work is required. When the mouse event is received, the x, y coordinates are converted to the original screen, that is, the graphic resolution of the broadcast receiver 410, to find a component within the x, y coordinates. . Moves the focus to the component in x, y coordinates and sends a keyboard event with the ENTER key value to the component that obtained the focus. Java provides a function that tells which component currently has the focus among the various components located in the root window, and provides an API (Application Program Interface) that indicates which component exists at the x and y positions. Do the work of.

When the event occurs, the Java program performs the corresponding action, and when the screen is changed, the frame buffer 416 is changed, so the image is captured by the graphic manager 413, and the graphic handler 423 Is sent to the user and shown to the user. Thus, the user can know that the Java program is running as he or she inputs.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

The present invention as described above, a system that can be viewed by any device by providing an optimized mechanism according to the specifications of the information terminal can watch the data broadcasting service anywhere in the house using the information terminal without data broadcasting middleware, This can increase the utilization of resources.

Claims (15)

In the data broadcasting service system in the home network environment, Data broadcast management means for receiving the data broadcast signal, separating the transport stream into an application and delivering the data broadcast handling means; The data broadcasting handling means for combining the transport stream and application information received from the data broadcasting managing means to the user, receiving the event input by the user, and transmitting the received event to the data broadcasting managing means; Service relay means for recognizing the data broadcast management means and the data broadcast handling means with each other by a predetermined protocol so as to exchange necessary messages; And Conversion means for converting media in order to match media compatibility between the data broadcasting management means and the data broadcasting handling means; Data broadcasting service system comprising a. The method of claim 1, The data broadcasting management means, Transport stream storage means for storing a broadcast stream; Frame storage means for storing graphic information of the broadcast stream; Event storage means for storing an event delivered from said handling means; Video management means for reading a broadcast stream from said transport stream storage means and delivering it to said data broadcast handling means via a communication protocol; Graphic management means for analyzing the broadcast stream and executing the application, when the user interface is drawn on the frame storage means to capture a single image and deliver the image to the data broadcast handling means; Event management means for requesting an application executed by the data broadcast management means to process the event received from the data broadcast handling means into the event storage means; Data broadcasting service system comprising a. The method of claim 1, The data broadcast handling means, Video handling means for handling the video signal transmitted from the data broadcasting management means and displaying the received video streaming on the screen; Graphic handling means for handling the graphic signal transmitted from the data broadcasting management means and displaying the received image on the video screen; And Event handling means for handling the event signal transmitted from the data broadcasting management means to deliver an event input by the user to the data broadcasting management means. Data broadcasting service system comprising a. The method according to any one of claims 1 to 3, The graphic management means, When the application includes the application in the data broadcasting transport stream and at the request of the user, a graphic screen shown by a programming guide or a TV menu is captured and transmitted to the graphic handling means. And a broadcast management means finds the data broadcast handling means and exchanges graphic resolution and supporting image format information to prepare for operation. The method of claim 4, wherein The event management means, Data broadcasting service, which is operated to exchange user input information with the event handling means, and is connected to the event handling means after compatibility check and connection for an audio / video (AV) stream and a graphic image are made. system. In the data broadcasting service method in a home network environment, A compatibility determination step of exchanging information to determine compatibility for video streaming after the ACAP manager and the ACAP handler are connected; As a result of the determination of the compatibility determination step, if compatible, the video manager and the video handler are connected for video streaming, the graphics manager and the graphics handler are connected, and the event manager and the event handler are connected to initialize the ACAP service to be retransmitted. An initialization task performing step of performing a task; As a result of the determination of the compatibility determination step, if compatibility is not achieved, find an AV converter service serving as a connection between the ACAP manager and the ACAP handler, check the media conversion function, and convert the media to the information terminal, A media conversion step of proceeding to performing the initialization operation; And Retransmission of the data broadcasting service for retransmitting the data broadcasting service after setting the path between the ACAP manager and the ACAP handler Data broadcasting service method comprising a. The method of claim 6, The compatibility determination step, Information exchanged between the ACAP manager and the ACAP handler to check an audio / video (AV) stream or graphic capability, and whether the audio / video (AV) stream or a graphic image is processed. Service type (SERVICE_TYPE) for distinguishing information, a format (FORMAT) that is information about a content encoding method, a transport (TRANSPORT) that is transport protocol information, and a resolution (speaking resolution) that can be supported by a target device. Data broadcasting service method comprising the information. The method of claim 7, wherein The information is, When the ACAP manager finds the ACAP handler and requests it, the ACAP handler receives and analyzes the ACAP handler, and if the information includes compatible information, the ACAP manager selects the best resolution and interworks with it. Otherwise, the AV converter Search and find a device that supports real-time conversion to an audio / video (AV) format supported by the ACAP handler, if present, connect to the AV converter, and connect the AV converter and the audio / video ( AV) is required to connect, and if the AV converter that supports real-time conversion is not found, the operation of the audio / video (AV) manager and the audio / video (AV) handler is failed and the event is transmitted. Data broadcasting service method. The method according to any one of claims 6 to 8, The data broadcasting service retransmission step, A data broadcasting service method comprising a retransmission process of an audio / video (AV) stream, an application retransmission process, and a user input process. The method of claim 9, The retransmission process of the audio / video (AV) stream, The broadcast receiver stores the MPEG-2 transport stream TS received from the tuner in the transport stream buffer immediately before going to the demux and transmits it to the AV converter or the video handler. Select the transmission protocol to transmit in real time, but establish the connection path by checking the transmission time and format conversion time to see if streaming can be done in real time without interruption, and the termination requests STOP from the information terminal side or A data broadcasting service method for generating a system event through an event manager and an event handler when a shortage occurs. The method of claim 10, The video handler, Receives audio / video (AV) streaming from the AV converter or video manager and inputs it to the video encoder of the information terminal. When interworking with the video manager, the video format and resolution supported by the system information from the system information, and Data broadcasting service method characterized in that notified after searching the transport protocol information. The method of claim 9, The application retransmission process, The actual application is performed in the broadcast receiver, and the graphic screen is captured as an image and transmitted to the information terminal using a communication protocol, and the information terminal is configured to overlap the received screen image with the video screen. Data broadcasting service method characterized in that the display. The method of claim 12, The graphic screen, When the graphic manager detects that the screen of the application is changed by monitoring the frame buffer of the broadcast receiver, after capturing the frame area as an image, the graphic manager sends the graphic handler to the graphic handler. After converting the image size to match the resolution of the information terminal and transmitting it, if the information terminal can process an alpha blending supported image format such as PNG (Portable Network Graphics) in order to prevent waste of network resources, the format is converted. After the data broadcasting service method characterized in that the transmission. The method of claim 13, The graphics handler is When connecting with the graphic manager, it transfers its resolution and supportable image format, processes the basic procedure for executing the application, receives the image transmitted from the graphic manager, converts it into a BMP image, and overlays it on the video screen. Data broadcasting service method characterized in that the output. The method of claim 9, The user input processing process, Intercept an event generated when an event handler inputs with a predetermined device of a user in the middle, and delivers it to the event manager, but registers an event generated on the screen of a graphic handler to be processed in the event handler. The event processing routine analyzes the type of event and transmits it to the event manager, wherein the event manager finds a component having an input focus to process an event transmitted from the event handler and generates an input event. Service method.

Images