KR20100028981A - Apparatus and method for providing virtual pc using broadcasting receiver and mobile terminal - Google Patents

Abstract

PURPOSE: A virtual PC apparatus using a broadcasting receiver and a mobile communications terminal and a method thereof are provided to smoothly control a personal computer by remote with PC application. CONSTITUTION: A personal computer(33) practices application. A broadcasting receiver(12) indicates contents images on a screen. A mobile communications terminal(16) receives a message of a selecting signal. A virtual PC server(20) receives connection request of the personal computer from the mobile communications terminal. According to a connection request, the virtual PC servers connect a data session of the PC and the broadcasting receiver. The virtual PC server indicates images of the PC on the screen.

Description

Apparatus and method for providing virtual PC using broadcasting receiver and mobile terminal}

The present invention relates to a technology for providing a personal computer (PC), and more particularly, a broadcast receiver capable of remotely controlling a PC using a mobile communication terminal while checking a screen of a remote PC through a broadcast receiver. And a virtual PC providing apparatus and method using a mobile communication terminal.

Information and communication technology using wired and wireless communication networks is growing very fast in a short period of time due to new technologies and functions that stimulate consumer purchasing. In particular, due to the development of the technology, a mobile communication terminal has been installed with various applications that meet the needs of users beyond a simple application. As a result, the user may use voice information, text information, image information, moving picture expert group (MPEG) layer 3 (MPEG), a game, and the like through the mobile communication terminal.

In addition, recently, IPTV (Internet Protocol TeleVision), DMB (Digital Multimedia Broadcasting), DVB (Digital Video Broadcasting) or satellite broadcasting provides a variety of content video.

In particular, the IPTV service is an interactive television service provided using an IP network. The convergence of communication and broadcasting enables the communication of information and emotions, and provides various additional services of high quality. Internet based convergence service.

The IPTV service converts existing content such as video, picture, voice, and data into the same packet and provides it to the subscriber. IPTV service is provided to subscribers by converting various types of contents such as voice and video through information service as well as video that can be easily accessed through terrestrial, satellite, and cable broadcasting services to packet data with the same IP address. do. In addition, IPTV service provides a function that can change and store the content implemented in the TV according to the needs of subscribers.

However, since IPTV service is merely a combination of TV viewing service and Internet service, there is a limit in controlling a PC remotely through IPTV.

In addition, even in the case of a service for controlling a remote PC through the mobile communication terminal and receiving the result values, there is a limit in controlling the remote PC because the screen size of the mobile communication terminal is small.

In order to solve the above problems, an object of the present invention is to provide a broadcast receiver and a virtual PC providing apparatus and method using a mobile communication terminal that can smoothly control a PC remotely using a mobile communication terminal and a broadcast receiver. There is.

Another object of the present invention is to provide a broadcast receiver and an apparatus and method for providing a virtual PC using the mobile communication terminal which can solve the limitation of the PC control due to the limitation of the screen size of the mobile communication terminal.

In order to achieve the above object, the present invention provides a virtual PC providing apparatus comprising a PC, a broadcast receiver, a mobile communication terminal and a virtual PC server. The PC executes an application. The broadcast receiver displays a content image on the screen. The mobile communication terminal receives a selection signal of a user watching the content image. The virtual PC server receives a request for connection with the PC from the mobile communication terminal while viewing the content image, connects the data session of the broadcast receiver and the PC according to the connection request, and broadcasts the screen image of the PC. Display on the receiver screen.

The virtual PC server of the apparatus for providing a virtual PC according to the present invention includes a transceiver, a session connection unit, and a controller. The transceiver receives a connection request with a PC from a mobile communication terminal of a user who is watching a content image through a broadcast receiver. The session connection unit connects a data session between the broadcast receiver and the PC according to the connection request. The controller controls the transceiver to receive the screen image of the PC from the connected PC and transmit the screen image to the broadcast receiver.

The virtual PC server according to the present invention may further include a finger image analyzer. The finger image analyzer receives a finger image photographed by the mobile communication terminal through the transceiver and analyzes the position and movement of the finger in the received finger projection to determine a key and key matching of a virtual keyboard displayed on a broadcast receiver. To perform.

The virtual PC server according to the present invention further comprises a virtual PC database for registering authentication information required for use of the PC received through the transceiver. At this time, the authentication information includes the MAC address and IP address of the PC, the IP address or ID of the set-top box connected to the PC.

On the other hand, the present invention, the virtual PC server receives a request for connection to the PC from the mobile communication terminal of the user viewing the content image through the broadcast receiver, and the virtual PC server and the broadcast receiver in response to the connection request A connection process of connecting a data session between the PCs, and the virtual PC server transmitting a screen image of the PC received from the PC to which the session is connected to the broadcast receiver and displaying the screen image on the screen of the broadcast receiver. Provided are a virtual PC providing method using a broadcast receiver and a mobile communication terminal.

The virtual PC providing method according to the present invention includes a setting process of setting an account to be logged in when the PC is used as a virtual PC, a usage allowance range, and the virtual PC server performed before the receiving process. It further comprises a registration process for receiving and registering authentication information required for the use of.

In the virtual PC providing method according to the present invention, the virtual PC server, which is performed after the registration process, periodically checks whether the registered PC is available as a virtual PC and updates the list of connectable PCs. It further comprises a check process.

In the virtual PC providing method according to the present invention, in the connecting process, the virtual PC server transmits and displays the list to the broadcast receiver according to the connection request, and the PC to be used as the virtual PC is selected from the displayed list. If so, the virtual PC server is configured to include a data session between the selected PC and the broadcast receiver.

In the virtual PC providing method according to the present invention, the virtual PC server, which is performed after the displaying process, receives the set account from the mobile communication terminal, and the virtual PC server connects the received account to a data session. And transmitting to the connected PC to log in, and the virtual PC server receiving a user's selection signal from the mobile communication terminal and controlling the logged-in PC within the allowable use range of the logged-in PC. Can be configured. In this case, the user's selection signal is input through a virtual keyboard displayed on the touch screen of the mobile communication terminal, or a virtual keyboard is displayed on the screen of the broadcast receiver, and the location of the user's finger photographed by the camera of the mobile communication terminal; It may be input through key matching of the virtual keyboard according to the movement.

According to the present invention, when using an application through a separate PC while watching a content image through a broadcast receiver, after connecting the broadcast receiver and the PC, and remotely executing the application in the PC using a mobile communication terminal, Since the video data of the execution result is received in real time and displayed on the broadcast receiver, it is possible to smoothly control the PC remotely using the mobile communication terminal and the broadcast receiver.

In addition, since the image of the application running on the PC is displayed through the broadcast receiver, the limitation of PC control due to the limitation of the screen size of the mobile communication terminal can be removed.

In addition, the apparatus for providing a virtual PC according to the present invention inputs a user's selection signal required for controlling a PC through a virtual keyboard displayed on a touch screen of a mobile communication terminal, or displays a virtual keyboard on a screen of a broadcast receiver, according to a user's finger movement. Since the user can input the user's selection signal for PC control by matching the key selection of the virtual keyboard, the user can control the PC remotely through smooth key input using the mobile communication terminal. Convenience can be improved.

Hereinafter, with reference to the accompanying drawings will be described in detail an embodiment of the present invention. The broadcast receiver is a terminal that receives and displays various content images on the screen through an IPTV service, digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or satellite broadcasting. DMB includes terrestrial DMB (also called 'T-DMB') and satellite DMB (also known as 'S-DMB'). The broadcast receiver includes a display device capable of providing a wide screen to the viewer. The display device includes a cathode ray tube (CRT), a liquid crystal display (LCD), or a plasma display panel (PDP).

Meanwhile, in the embodiment of the present invention, IPTV is illustrated as a broadcast receiver.

In the virtual PC providing apparatus 100 according to an exemplary embodiment of the present invention, as illustrated in FIGS. 1 and 2, the mobile communication terminal 16, the IPTV 12, and the content providing connected through the IP network 10 are provided. It comprises a server 31, a virtual PC server 20 and a PC 33. The IPTV 12 and the PC 33 are connected to the IP network 10 via the set top boxes 14 and 35, respectively.

The IP network 10 performs a series of data transmission / reception operations for call connection between the mobile communication terminal 16, the IPTV 12, the content providing server 31, the virtual PC server 20, and the PC 33. . The IP network 10 provides a transmission / reception service of a large amount of data and a seamless data service through IP. The IP network 10 may be an ALL-IP network, which is an IP network structure integrating different networks based on the Internet protocol.

The mobile communication terminal 16 is connected to the IPTV 12 via the first set top box 14 or the virtual PC server 20 via the IP network 10. The mobile communication terminal 16 receives the selection signal from the user watching the IPTV 12 and transmits the selection signal to the first set-top box 14 or the virtual PC server 20.

In particular, the mobile communication terminal 16 is an input means for receiving a user's selection signal, and includes a touch screen 17 and a camera 18. The touch screen 17 simultaneously performs functions as a display device and an input device. That is, the touch screen 17 displays state information generated during the operation of the mobile communication terminal 16 and data stored in the memory. The touch screen 17 displays a virtual keyboard in the touch screen input mode and receives a user's selection signal according to the touch of the virtual keyboard. At this time, the user's selection signal may be transmitted to the virtual PC server 20 in ASCII code. The camera 18 photographs a subject and outputs image information. The camera 18 includes a Charge Coupled Device (CCD) or Complementary Metal Oxide Semiconductor (CMOS) image sensor. In particular, the camera 18 captures the user's finger image in the virtual input mode by analyzing the hand image.

The mobile communication terminal 16 according to the present embodiment is a communication terminal that can be connected to the IP network 10, and includes a PDA (Personal Digital Assistant), a smart phone, an IMT-2000 (International Mobile Telecommunication 2000) phone, and a GSM (Global System). for Mobile Communication (GPRS) phone, General Packet Radio Service (GPRS) phone, Wideband Code Division Multiple Access (WCDMA) phone, Universal Mobile Telecommunication Service (UMTS) phone, Mobile Broadband System (MBS) phone, and the like.

The IPTV 12 and the content providing server 31 provide an IPTV service through the IP network 10. The IPTV 12 is connected to the IP network 10 via the first set-top box 14, and the content providing server 31, the virtual PC server 20, or the PC 33 via the IP network 10. Is connected to. When the IPTV 12 requests a service of a specific content to the content providing server 31, the content providing server 31 converts the requested content into packet data and provides the same to the IPTV 12. In particular, when the IPTV 12 is connected to the PC 33 and the IP network 10 during content playback, the IPTV 12 displays the screen image of the PC 33 on the content image. ) Can be displayed. In addition, the IPTV 12 displays the virtual keyboard on the screen in the virtual input mode by hand image analysis.

The IPTV 12 according to the present embodiment is a display device connected to the first set-top box 14 to provide an IPTV service, and includes a cathode ray tube (CRT), a liquid crystal display (LCD), or a plasma display panel (PDP). ) Includes a display device.

The PC 33 is connected to the IP network 10 via the second set top box 35. The PC 33 may be connected to the IP network 10 and provided as a virtual PC. The PC 33 stores an account to log in when used as a virtual PC and setting information in which a usage allowance range is set. The usage allowance range includes information on the capacity of the applications and storage spaces allowed when the virtual PC is used among the applications and storage spaces (hard disk, memory) operated on the PC 33. In this case, the PC 33 may be an indoor PC installed in the home where the IPTV 12 is installed or a remote PC outside the home. In the present embodiment, the remote PC is illustrated as the PC 33.

The virtual PC server 20 controls the provision of the virtual PC through the IP network 10 according to the user's request while watching the IPTV. The virtual PC server 20 includes a transmission / reception unit 23, a session connection unit 25, and a control unit 21. The transceiver 23 performs communication between the mobile communication terminal 16, the IPTV 12, the content providing server 31, and the PC 33. In particular, the transceiver 23 receives a connection request with the PC 33 from the mobile communication terminal 16 of the user watching IPTV.

The session connection unit 25 connects the data session between the IPTV 12 and the PC 33 in accordance with the connection request. In addition, the session connection unit 25 connects the data session with the mobile communication terminal 16 according to the selection of a touch screen input method through the IPTV 12 or an input method according to finger image analysis.

The controller 21 performs an overall control operation of the virtual PC server 20. In particular, the controller 21 controls the transceiver 23 to receive the screen image of the PC 33 from the PC 33 to which the session is connected and transmit the screen image to the IPTV 12.

The virtual PC server 20 further includes a virtual PC database 29 that stores data necessary for providing the virtual PC. The virtual PC database 29 registers authentication information of the PC 33 to be shared as a virtual PC. The authentication information includes a MAC address and an IP address of the PC 33 and an IP address or ID of the second set-top box 35 connected to the PC 33. The user registers the authentication information of the PC 33 in the virtual PC database 29 through a communication terminal that can access the virtual PC server 20 through the IP network 10. In this case, the communication terminal may be a mobile communication terminal or a PC.

The controller 21 periodically checks whether the PC registered in the virtual PC database 29 is usable as a virtual PC, and checks the result of the check in the form of a list (hereinafter referred to as a 'PC list'). Update and store in (29). At this time, the PC list can display only connectable PCs, and can also display whether all registered PCs can be connected.

The virtual PC server 20 analyzes the position and movement of the finger in the finger image captured by the mobile communication terminal 16 to perform key matching with the keys of the virtual keyboard displayed on the IPTV 12. More). That is, in the virtual input mode by hand image analysis, the finger image photographed by the mobile communication terminal 16 is transmitted to the transmission / reception unit 23 through the mobile communication terminal 16 or the IPTV 12. The transceiver 23 transmits the received finger image to the finger image analyzer 27. The finger image analyzer 27 performs key matching to determine which key of the virtual keyboard displayed on the IPTV 12 is selected by analyzing the position and movement of the finger over time in the captured finger image.

At this time, the controller 21 transmits the key selection signal according to the key matching analyzed by the finger image analyzer 27 to the PC 33 and the IPTV 12 selected as the virtual PC through the transceiver 23. The PC 33 displays the resultant image of the currently executing application according to the key selection signal. IPTV 12 indicates that the corresponding key is selected on the virtual keyboard according to the key selection signal. At this time, the IPTV 12 displays the resultant image of the PC 33 on the screen as a PIP.

A method of providing a virtual PC using the IPTV 12 and the mobile communication terminal 16 according to the present embodiment will be described with reference to FIGS. 1 to 3 as follows. 3 is a flowchart illustrating a virtual PC providing method using the IPTV 12 and the mobile communication terminal 16 according to the present embodiment.

First, in the process of S41, the PC 33 to provide a virtual PC function through the IPTV 12 sets an account to be used when logging in as a virtual PC and a usage allowance range. Also, in step S43, the PC 33 is registered as a virtual PC in the virtual PC server 20. That is, the user registers the authentication information of the PC 33 in the virtual PC database 29 through a communication terminal that can access the virtual PC server 20 through the IP network 10.

Next, in step S45, the virtual PC server 20 determines whether the check period of the registered virtual PC has arrived. As a result of the determination in step S45, when the check cycle of the virtual PC arrives, in step S47, the virtual PC server 20 checks whether or not the registered PC 33 is usable as the virtual PC, and checks the check result on the PC list. In the virtual PC database 29. The virtual PC server 20 periodically performs a process S45 to update and store the PC list.

After the check cycle of the virtual PC has not arrived at step S45 or after performing step S47, at step S49, the virtual PC server 20 determines whether the IPTV 12 requests a connection to the content providing server 31. To judge.

If it is determined in step S49 that the connection request is not made, the virtual PC server 20 performs the process again from step S45. As a result of the determination in step S49, if there is a connection request, in step S51, the virtual PC server 20 connects the IPTV 12 and the content providing server 31 via the IP network 10 as a medium. Subsequently, in step S53, the IPTV 12 receives and plays the content received from the content providing server 31. Accordingly, the user can watch the content played through the IPTV 12.

In step S55, the virtual PC server 20 determines whether a connection request from the user to the virtual PC is received while watching the IPTV 12. In this case, the user may request a connection to the virtual PC through the mobile communication terminal 16 or the IPTV 12. For example, the user may request a connection to the virtual PC through a specific key or menu selection provided in the mobile communication terminal 16 or the IPTV 12.

If there is no connection request as a result of the determination in step S55, the virtual PC server 20 maintains the state of step S53.

If there is a connection request in step S55, in step S57, the virtual PC server 20 transmits a list of connectable PCs to the IPTV 12. In step S59, the IPTV 12 displays the received PC list. The PC list displays the connected home PC and the remote PC 33.

At this time, the PC list includes names of connectable PCs and information on the allowable range of the corresponding PC. Therefore, the user can select the connectable PC displayed in the PC list and the PC to be connected after checking the allowable range of the corresponding PC. For example, the user may select one of the connectable PCs whose application to be used is within the allowable range.

Next, in step S61, the virtual PC server 20 determines whether a PC to be connected is selected. As a result of the determination in step S61, if the PC to be connected is not selected, the PC list display state in step S59 is maintained.

As a result of the determination in step S61, when the PC to be connected is selected, the virtual PC server 20 connects the data session between the selected PC 33 and the IPTV 12 in step S63. In operation S65, the virtual PC server 20 displays the screen image of the PC 33 to which the session is connected on the screen of the IPTV 12. That is, the virtual PC server 20 receives the screen image of the PC 33 from the PC 33 to which the session is connected, and transmits the screen image to the IPTV 12. The IPTV 12 displays the screen image of the received PC 31. At this time, the IPTV 12 displays the screen image of the PC 33 received on the content image being viewed in a PIP form.

Therefore, the same screen image as the screen image displayed on the monitor of the PC 31 to which the session is connected is displayed on the screen of the IPTV 12.

Meanwhile, when the power of the selected PC 33 is turned off in step S61, the virtual PC server 20 may remotely turn on the PC 31 through the second set-top box 35. . At this time, the second set-top box 35 is connected to the PC 33 and a wired / wireless connector so that the PC 31 can be turned on or off under the control of the virtual PC server 20.

Next, in step S67, the virtual PC server 20 receives the set account from the user and logs in to the connected PC 33. That is, the virtual PC server 20 receives an account set up from the mobile communication terminal 16. The virtual PC server 20 sends the received account to the PC 33 to which the data session is connected and logs in.

In operation S69, the virtual PC server 20 receives the user's selection signal and controls the logged-in PC 33. At this time, the user's selection signal is input to the virtual PC server 20 by a touch screen input method or an input method according to finger image analysis. That is, the touch screen input method is a method of inputting a user's selection signal through a virtual keyboard displayed on the touch screen 17 of the mobile communication terminal 16. The input method according to the finger image analysis displays a virtual keyboard on the screen of the IPTV 12 and through key matching of the virtual keyboard according to the position and movement of the user's finger captured by the camera 18 of the mobile communication terminal 16. Input method.

Specifically, the PC control process of the S69 process using the touch screen input method will be described with reference to FIGS. 4, 5A, and 5B.

When the touch screen input menu of the mobile communication terminal 16 is selected among the input menus through the IPTV 12 in step S71, the IPTV 12 transmits a menu selection signal to the virtual PC server 20 in step S72.

In step S73, the virtual PC server 20 connects the data session with the mobile communication terminal 16. Subsequently, in step S74, the mobile communication terminal 16 displays the virtual keyboard 13 on the touch screen 17.

Next, in step S75, the mobile communication terminal 16 determines whether a specific key of the virtual keyboard 13 is selected through a touch of a touch mechanism 17a such as a stylus pen. If the specific key is not selected as a result of the determination in step S75, the mobile communication terminal 16 maintains the display state of the virtual keyboard 13 in step S74.

As a result of the determination in step S75, when a specific key is selected through a touch, in step S76, the virtual PC server 20 receives a key selection signal of the mobile communication terminal 16 and transmits it to the PC 33. At this time, the virtual PC server 20 converts the input key selection signal into an ASCII code and transmits it to the PC 33.

In step S77, the PC 33 displays the resultant image according to the received key selection on the monitor 33a. That is, the PC 33 executes a command matched to the received key selection and displays the result on the monitor 33a. For example, the command matched to the key selection includes a command necessary for executing a specific application of the PC 33 and performing a job using the executed application.

In operation S78, the virtual PC server 20 receives the resultant image from the PC 33 and transmits the resultant image to the IPTV 12. In operation S79, the IPTV 12 updates and displays the received result image on the screen as a PIP.

Therefore, when the user needs to use the PC while watching the IPTV 12, while viewing the same screen image as the screen image of the PC 33 via the IPTV 12, the user can remotely operate the PC function using the mobile communication terminal 16. Can be used.

For example, a process of turning on the screen of the IPTV 12 by using the application of the PC 33 during the PC control process using the touch screen input method will be described with reference to FIGS. 5A and 5B. The PC 33 includes a monitor 33a and a main body 33b, and may further include an input device such as a keyboard or a mouse.

After the data session is connected between the PC 33 and the IPTV 12 selected in step S63, as shown in FIG. 5A, the monitor 33a of the PC 33 and the screen 15 of the IPTV 12 are the same. The screen image is displayed. The execution screens 37a and 37b of the application capable of capturing the screen 15 of the IPTV 12 as the screen image are displayed. The mobile communication terminal 16 displays a virtual keyboard 13 capable of receiving a user's selection signal. In this case, the application execution screens 37a and 37b include a menu required for application operation and a work window.

Next, when the user touches the key corresponding to the screen capture execution command on the virtual keyboard 13 by using the touch mechanism 17a, the PC 33 displays the screen of the IPTV 12 as shown in FIG. 5B. 15) Capture and display on the task pane. On the monitor 33a of the IPTV 12 and the PC 33, the application execution screens 37a and 37b together with the captured screen 15a on the work window are displayed together. That is, the virtual PC server 20 receives the application execution screen 37a in which the screen 15a on which the IPTV 12 is turned on is transmitted from the PC 33 to the IPTV 12. IPTV 12 updates and displays the received application execution screen 37a. Therefore, the IPTV 12 displays the same application execution screen 37b as the application execution screen 37a displayed on the monitor 33a of the PC 33.

Next, a PC control process using an input method according to finger image analysis will be described with reference to FIGS. 6, 7A, and 7B. First, the mobile communication terminal 16 is connected to the first set top box 14 of the IPTV 12, and the camera 18 is positioned to face the user's finger.

When the virtual input menu by hand image analysis is selected among the input menus through the IPTV 12 in step S81, the IPTV 12 transmits a menu selection signal to the virtual PC server 20 in step S82.

In step S83, the virtual PC server 20 connects the data session with the mobile communication terminal 16. In operation S84, the IPTV 12 displays the virtual keyboard 11 on the screen 15. In this case, the IPTV 12 may display only the virtual keyboard 11 on the screen 15 or display the images 19 of both hands on the virtual keyboard 11. Compared to the virtual keyboard 11, the image 19 of both hands may be displayed transparently so that the virtual keyboard 11 is not completely covered by the overlapping images 19 of both hands.

In operation S85, the camera 18 of the mobile communication terminal 16 photographs a user's finger movement and transmits the finger image photographed in operation S86 to the virtual PC server 20. At this time, the captured finger image is a video.

In operation S87, the virtual PC server 20 performs key matching between the captured finger image and the virtual keyboard 11. That is, the finger image photographed by the mobile communication terminal 16 is received by the transceiver 23 through the first set-top box 14 of the mobile communication terminal 16 or the IPTV 12. The transceiver 23 transmits the received finger image to the finger image analyzer 27. The finger image analyzer 27 performs key matching to determine which key of the virtual keyboard 11 displayed on the IPTV 12 is selected by analyzing the position and movement of the finger over time in the captured finger image. do.

In operation S88, the virtual PC server 20 transmits a key selection signal based on key matching to the PC 33. In step S91, the PC 33 displays the resultant image according to the received key selection on the monitor 33a. That is, the PC 33 executes a command matched to the received key selection and displays the result on the monitor 33a. For example, the command matched to the key selection includes a command necessary for executing a specific application of the PC 33 and performing a job using the executed application.

In addition, in step S89, the virtual PC server 20 transmits a key selection signal according to key matching to the IPTV 12. In step S92, the IPTV 12 displays the selected key according to key matching on the virtual keyboard 11. For example, the IPTV 12 may display the selected key according to key matching as a highlight, or move the finger used to press the selected key when the finger image 19 is displayed together on the virtual keyboard 11 to display the selected key. Can be.

In operation S93, the virtual PC server 20 receives the resultant image from the PC 33 and transmits the resultant image to the IPTV 12. In operation S94, the IPTV 12 updates and displays the received result image on the screen 15 as a PIP.

Therefore, when the user needs to use the PC 33 while watching the IPTV 12, while viewing the same screen image as the screen image of the PC 33 via the IPTV 12, the user remotely uses the mobile communication terminal 16. PC function can be used.

For example, a process of turning on the screen 15 of the IPTV 12 using an application of the PC 33 during the PC control process using the input method according to the finger image analysis will be described with reference to FIGS. 7A and 7B. .

After the data session is connected between the PC 33 and the IPTV 12 selected in step S63, as shown in FIG. 7A, the monitor 33a of the PC 33 and the screen 15 of the IPTV 12 are the same. The screen image is displayed. The execution screens 37a and 37b of the application capable of capturing the screen 15 of the IPTV 12 as the screen image are displayed. The IPTV 12 displays a virtual keyboard 11 capable of receiving a user's selection signal. In this case, the application execution screens 37a and 37b include a menu required for application operation and a work window.

At this time, the IPTV 12 displays the application execution screen 37b as the PIP on the main screen 15 displaying the content image, and the virtual keyboard in which the two-handed image 19 is superimposed on the lower portion of the screen 15 of the IPTV 12. (11) is displayed. Meanwhile, in the present exemplary embodiment, an example in which the virtual keyboard 11 is disposed at the lower end of the screen 15 is disclosed. However, the present invention is not limited thereto, and the virtual keyboard 11 may be disposed on the screen 15 in a range that does not overlap the application execution screen 37b. .

Next, when the user performs the operation of selecting and moving the finger with a key corresponding to the screen capture execution command of the virtual keyboard 11 while watching the screen 15 of the IPTV 12, as shown in FIG. 7B, the virtual PC Under the control of the server 10, the PC 33 captures the screen 15 of the IPTV 12 and displays it on the work window. On the monitor 33a of the IPTV 12 and the PC 33, the application execution screens 37a and 37b together with the captured screen 15a on the work window are displayed together. The IPTV 12 displays the two-handed image 19 on the virtual keyboard 11 to correspond to the movement of both hands of the user.

That is, when the user performs the operation of selecting and moving a finger with a key corresponding to the screen capture execution command of the virtual keyboard 11 while watching the screen 15 of the IPTV 12, the camera 18 of the mobile communication terminal 16 is selected. ) Photographed and transmitted to the first set-top box 14. The first set top box 14 transmits the captured finger image to the virtual PC server 20. The virtual PC server 20 performs key matching to determine which key of the virtual keyboard 11 displayed on the IPTV 12 is selected by analyzing the position and movement of the finger over time in the received finger image. .

The virtual PC server 20 transmits a key selection signal according to key matching to the PC 33. The PC 33 displays the resultant image according to the received key selection on the monitor 33a. That is, the PC 33 captures the screen 15 of the IPTV 12 according to the screen capture execution command matched with the received key selection and displays it on the work window.

The virtual PC server 20 transmits a key selection signal according to key matching to the IPTV 12. The IPTV 12 displays the selected key according to key matching on the virtual keyboard 11. That is, IPTV 12 moves the finger used to press the selected key according to key matching on the selected key, and highlights the selected key.

In addition, the virtual PC server 20 receives the application execution screen 37a in which the turned on screen 15a of the IPTV 12 is displayed on the work window from the PC 33 and transmits it to the IPTV 12. IPTV 12 updates and displays the received application execution screen 37a. Therefore, the IPTV 12 displays the same application execution screen 37b as the application execution screen 37a displayed on the monitor 33a of the PC 33.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to aid understanding, and are not intended to limit the scope of the present invention. In addition to the embodiments disclosed herein, it is apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be implemented.

The present invention connects a broadcast receiver and a PC through a communication network to display an image displayed on the monitor of the PC on the screen of the broadcast receiver, and remotely control the functions of the PC using a mobile communication terminal while viewing the screen of the broadcast receiver on which the PC image is displayed. By controlling, the user can smoothly use the PC application remotely while watching the broadcast receiver.

1 is a block diagram showing an apparatus for providing a virtual PC using an IPTV and a mobile communication terminal according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of the virtual PC server of FIG. 1.

3 is a flowchart illustrating a virtual PC providing method using an IPTV and a mobile communication terminal according to an embodiment of the present invention.

4 is a flowchart illustrating a PC control process using the touch screen input method of FIG. 3.

5A and 5B are exemplary views of the screen of FIG. 4.

6 is a flowchart illustrating a PC control process using the input method according to the finger image analysis of FIG. 3.

7A and 7B are exemplary views of the screen of FIG. 6.

Description of the main parts of the drawing

10: IP network 12: IPTV

14: first set-top box 16: mobile communication terminal

17: touch screen 18: camera

20: Virtual PC Server 31: Content Provision Server

33: PC 35: second set-top box

100: virtual PC providing device

Claims (15)

A PC running an application; A broadcast receiver displaying a received content image on a screen; A mobile communication terminal receiving a selection signal of a user watching the content image; Receiving a request for connection with the PC from the mobile communication terminal while viewing the content image, connecting the broadcast session with the data session of the PC according to the connection request, and displaying a screen image of the PC on the screen of the broadcast receiver; Virtual PC server using a broadcast receiver and a mobile communication terminal comprising a; virtual PC server. The method of claim 1, wherein the mobile communication terminal, A touch screen receiving the user's selection signal; And a camera for capturing the position and movement of a user's finger operating the virtual keyboard displayed on the screen of the broadcast receiver. The method of claim 2, wherein the virtual PC server, Receiving a finger image photographed by the mobile communication terminal, and analyzing the position and movement of the finger from the received finger image to perform key matching with a key of the virtual keyboard displayed on the broadcast receiver And a virtual PC providing apparatus using a mobile communication terminal. The method of claim 2, wherein the broadcast receiver, And a picture receiver (PIP) screen image of the PC on the content image. The method of claim 1, wherein the PC, An apparatus for providing a virtual PC using a broadcast receiver and a mobile communication terminal, which stores an account to log in when used as a virtual PC and setting information in which a usage allowance range is set. A transmitter / receiver configured to receive a connection request from a mobile communication terminal of a user who is viewing a content image through a broadcast receiver to a PC; A session connection unit for connecting a data session between the broadcast receiver and the PC according to the connection request; And a controller configured to control the transceiver to receive the screen image of the PC from the connected PC and transmit the screen image to the broadcast receiver. The method of claim 6, Finger image captured by the mobile communication terminal through the transceiver and the image of the finger and the key to the virtual keyboard displayed on the broadcast receiver by analyzing the position and movement of the finger in the received finger projection The virtual PC server of the virtual PC providing apparatus further comprises; an analysis unit. The method of claim 7, wherein And a virtual PC database for registering authentication information required for use of the PC received through the transceiver. The authentication information is a virtual PC server of the virtual PC providing device, characterized in that the MAC address and IP address of the PC, IP address or ID of the set-top box connected to the PC. The virtual PC server includes a receiving process of receiving a request for connection with a PC from a mobile communication terminal of a user who is watching a content image through a broadcast receiver; The virtual PC server connecting a data session between the broadcast receiver and the PC according to the connection request; The virtual PC server includes a display process of transmitting a screen image of the PC received from the PC connected to the session to the broadcast receiver to display on the screen of the broadcast receiver; broadcast receiver and a mobile communication terminal How to provide a virtual PC. The method according to claim 9, which is performed before the receiving process, A setting process of setting an account to log in to when the PC is used as a virtual PC and an allowable range of use of the PC; The virtual PC server further comprises a registration process for receiving and registering authentication information required for the use of the PC; Virtual PC providing method using a broadcast receiver and a mobile terminal. The method of claim 10, The authentication information is a virtual PC providing method using an IPTV and a mobile communication terminal, characterized in that it comprises a MAC address and IP address of the PC, the IP address or ID of the set-top box connected to the PC. The method according to claim 11, which is performed after the registration process, The virtual PC server periodically checks whether or not the registered PC is available as a virtual PC and checks the list of connectable PCs. The broadcast receiver and the mobile communication terminal further comprising: Virtual PC provision method using. The method of claim 12, wherein the linking process, Transmitting, by the virtual PC server, the list to the broadcast receiver according to the connection request; Selecting a PC to be used as a virtual PC from the displayed list, the virtual PC server connecting a data session between the selected PC and the broadcast receiver; and a virtual PC using a broadcast receiver and a mobile communication terminal. How to Provide. The method according to claim 13, which is performed after the displaying process. Receiving, by the virtual PC server, the set account from the mobile communication terminal; The virtual PC server transmitting the received account to the PC to which the data session is connected and logging in; The virtual PC server receives the user's selection signal from the mobile communication terminal and controlling the logged-in PC within the allowable use range of the logged-in PC; Broadcast receiver and mobile communication terminal further comprising a How to provide a virtual PC. The method of claim 14, wherein the user's selection signal, Input through a virtual keyboard displayed on a touch screen of the mobile communication terminal; Displaying a virtual keyboard on the screen of the broadcast receiver, and inputs through the key matching of the virtual keyboard according to the position and movement of the user's finger taken by the camera of the mobile communication terminal, the broadcast receiver and the mobile communication terminal How to provide a virtual PC.

Images