KR101212364B1 - System for interworking and controlling devices and user device used in the same - Google Patents

Abstract

PURPOSE: Terminal connection, a control system and a user terminal using the same are provided to display a second image related to a control operation of a user for a small size terminal on a first image of a big size terminal in a state that the first image is shared in terminals, thereby controlling an operation of the small size terminal with the big size terminal. CONSTITUTION: A size of an image unit(2310) is bigger than a user terminal and outputs image data. The first image corresponds to a first image shared in a receiving terminal watched by a user. A signal unit(2306) transmits image data outputted from the image unit and location information of a touch means touching the user terminal to the receiving terminal. The location information is information of the touch means touching the user terminal under a predetermined pressure level or a predetermined touch area. The location information is displayed in the receiving terminal as an image type. [Reference numerals] (2300) Control unit; (2302) Connection unit; (2304) Transmitting/receiving unit; (2306) Signal unit; (2308) Receiver unit; (2310) Image unit; (2312) Display unit; (2314) Storage unit

Description

Terminal interworking and control system and user terminal used in the same {SYSTEM FOR INTERWORKING AND CONTROLLING DEVICES AND USER DEVICE USED IN THE SAME}

The present invention relates to a system for interworking and controlling terminals.

Recently, people enjoy playing games, checking e-mails, or surfing the web using electronic terminals such as smartphones. The electronic terminal has the advantage of being convenient to carry because it is light and small, but there is also a disadvantage that the screen is not small enough to enjoy games. That is, due to the small size of the electronic terminal, the enjoyment of games, web surfing, etc. is halved and it is inconvenient to check e-mail.

The present invention provides a method and system for interlocking a large sized terminal with a small sized terminal and controlling the small sized terminal while viewing the large sized terminal.

In order to achieve the above object, the user terminal used in the terminal interworking system according to an embodiment of the present invention is larger in size than the user terminal and can be shared with the receiving terminal viewed by the user of the user terminal. An image unit for outputting image data corresponding to one image; And a signal unit for transmitting the image data output from the image unit and the position information of the touch means touching the user terminal to the receiving terminal. Here, the position information is position information of the touch means which touches the user terminal at a predetermined pressure level or contact area or less, and is displayed on the receiving terminal in the form of an image.

The user terminal used in the terminal interworking system according to another embodiment of the present invention has a larger size than the user terminal, and the first image and the touch means to be shared with the receiving terminal viewed by the user of the user terminal are connected to the user terminal. An image unit for outputting image data including a second image indicating a position of the touch means when touched; And a signal unit for transmitting the image data output from the image unit to the receiving terminal. Here, the position of the touch means is the position of the touch means which touches the user terminal to a predetermined pressure level or contact area or less, and the first image and the second image are displayed on the receiving terminal.

A user terminal used in a terminal interworking system according to another embodiment of the present invention includes a display unit; And a signal unit for transmitting image information and position information of the touch means touching the user terminal to a receiving terminal having a size larger than that of the user terminal and viewed by the user of the user terminal. Here, the position information is position information of the touch means which touches the user terminal at a predetermined pressure level or contact area or less, and is displayed on the receiving terminal in the form of an image.

delete

A user terminal used in a terminal interworking system according to another embodiment of the present invention includes a display unit; And a signal unit for transmitting the composite image data to a receiving terminal having a larger size than the user terminal and viewed by a user of the user terminal. Here, the composite image data includes first image data and second image data of a position of a touch means touching the user terminal, and the position of the touch means is less than or equal to a predetermined pressure level or contact area of the user terminal. The first image corresponding to the first image data and the second image corresponding to the second image data are displayed on the receiving terminal.

Since the method and system for connecting and controlling a terminal according to the present invention share a first image with terminals, a second image related to a user's control of a small terminal is displayed on the first image of the large terminal. The user can control the operation of the small size terminal while looking at the large size terminal. Therefore, the user can fully enjoy games, surfing the web, and the like through a small size terminal.

1 is a view schematically showing a terminal interworking and control system according to an embodiment of the present invention.
2 is a flowchart illustrating a terminal interworking and control method according to a first embodiment of the present invention.
3 is a diagram illustrating a control method used in the terminal interworking and control method of FIG. 2.
4 is a plan view illustrating an image sharing screen according to an exemplary embodiment of the present invention.
5 is a diagram illustrating a touch means sensing method according to an embodiment of the present invention.
6 is a view showing a touch means detection method according to another embodiment of the present invention.
7 is a diagram illustrating a touch means sensing method according to another embodiment of the present invention.
8 is a flowchart illustrating a terminal interworking and control method according to a second embodiment of the present invention.
9 is a flowchart illustrating a terminal interworking and control method according to a third embodiment of the present invention.
10 is a diagram illustrating a terminal interworking system according to another embodiment of the present invention.
11 is a flowchart illustrating a terminal interworking and control method according to a fourth embodiment of the present invention.
12 is a diagram illustrating a terminal interworking system according to another embodiment of the present invention.
13 is a flowchart illustrating a terminal interworking and control method according to a fifth embodiment of the present invention.
14 is a diagram illustrating a terminal interworking system according to another embodiment of the present invention.
15 is a block diagram showing the structure of a user terminal according to an embodiment of the present invention.
FIG. 16 is a block diagram illustrating a structure of the image unit of FIG. 15 according to an embodiment of the present invention. FIG.
17 is a block diagram showing the structure of a user terminal according to a second embodiment of the present invention.
18 is a block diagram showing the structure of a user terminal according to a third embodiment of the present invention.
19 is a block diagram showing the structure of a user terminal according to a fourth embodiment of the present invention.
20 is a block diagram showing the structure of a user terminal according to a fifth embodiment of the present invention.
21 is a block diagram showing the structure of a receiving terminal according to the first embodiment of the present invention.
22 is a block diagram showing the configuration of a receiving terminal according to a second embodiment of the present invention.
23 is a block diagram showing the configuration of a receiving terminal according to a third embodiment of the present invention.
24 is a block diagram showing a configuration of a receiving terminal according to a fourth embodiment of the present invention.
25 is a block diagram showing a configuration of a receiving terminal according to a fifth embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Terminal interworking and control system of the present invention relates to a system for interlocking and controlling the terminals, in particular a system for controlling the operation of the terminal based on the image sharing and the shared image. In particular, the terminal interworking and control system of the present invention, after interlocking a small size terminal directly controlled by the user, for example, a touch method and a large size terminal, while the user looks at the large size terminal of the small size Various methods for controlling the terminal are proposed. However, for convenience of description, a small sized terminal directly controlled by a user is called a user terminal, and a large sized terminal that receives location information of the touch means from the user terminal is called a receiving terminal. Of course, the user terminal preferably has a smaller size than the receiving terminal, but the size of the terminals is not limited to the above size.

The terminal used in the system of the present invention has a function of displaying an image and a wired / wireless communication function, but the communication function is not an essential function. However, considering the real life application, it is preferable that each terminal has an image display function and a communication function. The terminal is not limited to a specific device as long as it can display an image and transmit or receive a signal with another terminal, for example, a smartphone, a smart TV, a PC, a tablet PC, a laptop, a touch pad, a game console, a cloud PC, or the like. Various devices can be used as the terminal of the present invention. However, it is preferable that a terminal having a small size has a touch function.

Hereinafter, a terminal interworking and control system according to various embodiments of the present invention will be described with reference to the accompanying drawings. However, for convenience of description, an image shared by the terminals will be referred to as a first image, and an image representing position information of the touch means will be referred to as a second image (location display image).

1 is a view schematically showing a terminal interworking and control system according to an embodiment of the present invention.

Referring to FIG. 1, the terminal interworking and control system of the present embodiment includes a user terminal 100 and a receiving terminal 102.

The user terminal 100 may be an image display terminal directly controlled by the user, and may be, for example, a smartphone capable of executing a game such as Angry Birds. Preferably, the user terminal 100 is a terminal having a touch function and having a relatively small size.

The receiving terminal 102 is a terminal which is not directly manipulated by a user but interlocks with the user terminal 100 and which can display an image. The reception terminal 102 may be an element used for a different purpose than the user terminal 100, and may be, for example, a TV that broadcasts a broadcast program such as a drama. Preferably, the receiving terminal 102 is a terminal having a relatively large size, but does not necessarily have a touch function.

The terminals 100 and 102 may be connected directly or indirectly by wire or wirelessly using another device, and are connected through a plurality of channels, for example, two channels. One channel is used to transmit image data corresponding to the shared first image, and the other channel is used to transmit a control signal having position information of the touch means. The channels may all be wireless channels or wired channels, one may be a wireless channel and the other may be a wired channel. Of course, the terminals 100 and 102 may transmit and receive image data and control signals through one channel. For example, the transmission interval of the channel may include a control interval for transmitting a control signal between data intervals for transmitting image data. In particular, since a blank period exists between sections for transmitting image data (image signal), the blank period may be used as a control signal transmission section. For example, the user terminal 100 transmits image data to the receiving terminal 102 through one channel, but receives a control signal during a blank period between data sections for transmitting the image data. Can be sent to. However, when real-time interworking of the terminals 100 and 102 is important, it is preferable that a data channel for transmitting image data and a control channel for transmitting a control signal exist separately.

The user terminal 100 transmits the data corresponding to the first image to be displayed or displayed by the user to the receiving terminal 102 through the corresponding channel under the control of the user, and transmits the data to the receiving terminal 102 through the corresponding channel. The control signal may be separately transmitted to the receiving terminal 102 through the corresponding channel. Currently, terminals such as smartphones and TVs use wired communication standards such as high-definition multimedia interface (HDMI), mobile high definition link (MHL), displayport, and wireless communication standards such as WiFi, and they each transmit data. It is equipped with a separate control channel for transmitting and receiving control signals as well as a data channel. For example, HDMI uses CEC (Consumer Electronic Control), DDC (Display Data Channel), Utility, SCL / SDA as control channels, MHL uses CBUS as control channels, and Displayport controls auxiliary channels. I am using it as a channel. Therefore, it is not necessary to set up separate channels in order to interwork with the terminals 100 and 102, and channels already existing in the terminals 100 and 102 may be used as channels for transmitting the control signal of the present invention.

Although not mentioned above, the receiving terminal 102 may also transmit an image signal or the like to the user terminal 100. In this case, the receiving terminal 102 may use channels other than the above data channel / control channel, but it is preferable to use the same data channel / control channel.

When the user terminal 100 distributes the image data corresponding to the first image displayed by the user terminal to the image signal and transmits the image data to the receiving terminal 102 through the corresponding channel, the receiving terminal 102 transmits the image data through the image signal. Acquire and display a first image corresponding to the image data. As a result, the user terminal 100 and the receiving terminal 102 display the same first image, that is, share the first image. However, the first image displayed on the receiving terminal 102 is substantially the same as the first image displayed on the user terminal 100, but due to the characteristics of the terminal of the receiving terminal 102, the color is different or the display ratio is different. There is a number. Although the receiving terminal 102 may display the transmitted image data as a corresponding image without special processing, the receiving terminal 102 may display the first image by processing the transmitted image data according to its characteristics. That is, as long as the receiving terminal 102 can display an image substantially the same as the first image of the user terminal 100, the method of processing the transmitted image data may be variously modified.

When the same image as the first image of the user terminal 100 is displayed on the receiving terminal 102, the receiving terminal 102 may stop the existing executing program and display the first image or execute the existing executing program. It can also be run through a separate channel. In addition, the receiving terminal 102 may display the existing execution program together on the screen on which the first image is displayed. For example, the receiving terminal 102 may stop the drama, which is an existing execution program, and display the first image of the Angry Bird game that is executed in the user terminal 100, for example, by switching the drama to a separate channel. The first image may be broadcasted and the first image may be displayed on a corresponding channel, or the drama may be continuously broadcasted on the current channel, but the first image may be displayed on another channel. In addition, the receiving terminal 102 may display the first image on the current channel, but display the drama that was being aired in a separate pop-up window. However, since the present invention is intended for a user to view the first image of the user terminal 100 through the receiving terminal 102, the receiving terminal 102 stops a program executed in the current channel or displays the display through another channel. It is preferable to switch the screen of the current channel to the screen on which the first image is displayed.

According to another embodiment of the present invention, the receiving terminal 102 may share the first image by transmitting an image signal to the user terminal 100. Even in this case, the control signal reflecting the user's operation (touch operation) is transmitted from the user terminal 100 to the receiving terminal 102.

Image sharing between the user terminal 100 and the receiving terminal 102 is not performed only once, but the same image is displayed to the receiving terminal 102 whenever the first image of the user terminal 100 is switched. Therefore, when the user operates the user terminal 100, the first image corresponding to the operation is displayed on the receiving terminal 102. In particular, since the receiving terminal 102 has a relatively larger size than the user terminal 100, the user may control the user terminal 100, but the gaze may look at the receiving terminal 102. That is, the user may manipulate the user terminal 100 while looking at the receiving terminal 102.

However, if the user terminal 100 is not viewed, it is difficult to grasp its own operation, and if the receiver terminal 102 is not present, the screen is small, so that the present invention can easily control the user terminal 100 while watching the receiver terminal 102. Various methods and systems are proposed.

According to an embodiment of the present invention, when a touch means such as a user's finger touches the user terminal 100, a second image corresponding to the touch means is shown in the first image displayed on the receiving terminal 102. For example, a shadow image or the like may be displayed at the corresponding position, that is, the position of the touch means is specified on the first image. In the case of a general PC, not an interlocking system, if the mouse is moved, the position of the mouse is not specified to the exact position, and in the case of a smartphone, the image indicating the position is not displayed even if it is touched. On the other hand, the present invention specifies the touch position on the user terminal 100 to the receiving terminal 102 as a shadow image while interworking the user terminal 100 and the receiving terminal 102. Therefore, the user can check the position and the operation touched by the user while not looking at the user terminal 100 but can control the receiver terminal 102 without looking at the receiver terminal 102.

According to another embodiment of the present invention, once the position of the touch means is displayed on the receiving terminal 102 as the second image, when the user touches the user terminal 100 again with the touch means or moves to the touched state, the second means The image may be displayed in a position corresponding to the movement of the touch means after being converted from the shadow image to another image such as a finger image. As a result, the second image may move on the shared first image according to the movement of the touch means. Of course, it is also possible for the second image to continue to maintain an image at the time of position specification of the touch means, for example a shadow image. Using this method, the user can check the operation status of the touch means in the user terminal 100 through the receiving terminal 102, and as a result, the user can see the receiving terminal 102 without looking at the user terminal 100. The user terminal 100 can be easily controlled. For example, when a user is playing an Angry Birds game with a smartphone, the user may enjoy the Angry Birds game by operating the smartphone while watching only a TV screen having a large size. If the first image displayed on the user terminal 100 is changed to another first image according to a user's operation, the same first image is also displayed on the receiving terminal 102, in which case the second image is displayed on the new first image. It is displayed at that location. The second image may be displayed on the screen of the receiving terminal 102 based on the coordinates of the user terminal 100. Of course, the first image may be shared according to image data transmission of the user terminal 100 or may be shared according to image data transmission of the receiving terminal 102.

According to an embodiment of the present invention, the second image may be displayed continuously until the end of the interworking once it is displayed when the user terminal 100 and the receiving terminal 102 are interworking.

According to another embodiment of the present invention, when the user does not want to display the second image even during the linkage, if the user selects to omit the second image through a method of selecting a menu in the user terminal 100, the second image is displayed. The image may disappear on the screen of the receiving terminal 102. Of course, the user terminal 100 may continue to detect the position of the touch means. However, this method is inconvenient because the user cannot confirm his or her operation at the receiving terminal 102, so it is preferable to continuously display the second image during the interworking.

According to another embodiment of the present invention, when the user touches the touch pad once in the user terminal 100 having a touch pad separate from the display unit, such as a laptop, the corresponding position is shared in the receiving terminal 102. The second image can be displayed on the screen. Subsequently, when the user touches or moves the touch pad of the first image element 100 again or in a touched state, the second image may move corresponding to the movement.

In summary, the user terminal 100 and the receiving terminal 102 share the first image, and the user can easily manipulate the user terminal 100 having the small size while viewing the receiving terminal 102 having the large size. have. Therefore, the user may move the touch means such as a finger, a touch pen, etc. on the image of the user terminal 100 while looking at the receiving terminal 102, or click a menu icon displayed on the first image of the user terminal 100 to specify You can also run the function. Of course, according to the above execution, an image substantially identical to the new first image displayed on the user terminal 100 is displayed on the receiving terminal 102.

Although not described above, once the second image is specified on the receiving terminal 102, the second image may detect and reflect the position of the touch means. You can move along.

According to another embodiment of the present invention, the companion system may include a plurality of user terminals 100 and one receiving terminal 102. For example, when a plurality of users are playing the same game, the user terminals 100 are wired or wirelessly connected to the receiving terminal 102. When the user terminals 100 respectively transmit the position information of the corresponding touch means to the receiving terminal 102, the receiving terminal 102 displays second images indicating the positions of the touch means on the same first image. Can be. In this case, the first image shared by the user terminals 100 and the receiving terminal 102 may be transmitted by the specific user terminal 100 to the receiving terminal 102.

According to another embodiment of the present invention, when a plurality of touch means touches one user terminal 100 (multi-touch), for example, the user touches the user terminal 100 with one left and right fingers or a plurality of touch means. When the users touch one user terminal 100, the user terminal 100 transmits a control signal including the location information of the touch means to the receiving terminal 102, and the receiving terminal 102 responds to the control signal. Accordingly, second images corresponding to the location information may be displayed on the first image. Of course, shapes, colors or sizes may be different so that the second images are distinguished from each other. Meanwhile, the user terminal 100 may transmit a plurality of control signals having location information of each touch means to the receiving terminal 102.

According to another embodiment of the present invention, the user terminal 100 may sense the touch means by another method by realizing a plurality of sensing methods. For example, the user terminal 100 may sense a finger through a capacitive method and a touch pen using a receiver. Therefore, the user may implement multi-touch by simultaneously using a finger and a touch pen. As a result, the user can realize a separate operation by using a plurality of touch means.

According to another embodiment of the present invention, the user terminal 100 detects a position when one of the touch means touches, and the other touch means detects the position even when the touch means approaches the user terminal 100. Can be.

According to another embodiment of the present invention, the companion system may include a user terminal, a receiver terminal, and a companion server. The companion server transmits the first image to both the user terminal and the receiving terminal to display the same first image, and the user terminal transmits the position information of the touch means to the receiving terminal to display the second image on the first image. May be displayed.

Hereinafter, various embodiments of the terminal interworking and control method of the present invention will be described with reference to the accompanying drawings.

2 is a flowchart illustrating a terminal interworking and control method according to a first embodiment of the present invention, FIG. 3 is a diagram illustrating a control method used in the terminal interworking and control method of FIG. 2, and FIG. FIG. 1 is a plan view illustrating an image sharing screen according to an exemplary embodiment. This embodiment proposes a linkage and control method when the user terminal 100 transmits image data (image signal) to the reception terminal 102.

Referring to FIG. 2, the user terminal 100 requests the linkage of an image to the receiving terminal 102 (S200). Specifically, when the user connects the user terminal 100 to the receiving terminal 102 by wire or wirelessly and requests interlocking, or when the user terminal 100 is connected to the receiving terminal 102, the user terminal 100 or the receiving terminal 102. After the terminal 102 identifies the counterpart terminal, the terminal 102 may inquire whether to interwork with the counterpart terminal. Interworking of the terminals 100 and 102 may be performed at the request of a user, or may be automatically performed when the terminals 100 and 102 mutually identify each other. According to an embodiment of the present invention, as shown in FIG. 3A, the user terminal 100 and the receiving terminal 102 may be connected to two channels, that is, a data channel and a control channel, and may request an interworking request or Control signals for permission can be transmitted and received through the control channel.

Subsequently, the user terminal 100 distributes image data corresponding to the first image displayed on the screen to an image signal and transmits the image data to the receiving terminal 102 through the data channel, and the receiving terminal 102 transmits the transmitted image. The first image corresponding to the data is displayed (S202). That is, the user terminal 100 and the receiving terminal 102 share the first image. Since it is useful to display the first image of the user terminal 100 and the first image of the receiving terminal 102 at substantially the same time, the image portion of the user terminal 100 transmits the image data to the display unit when the image data is transmitted. It is desirable to transmit simultaneously to the receiving terminal 102 through the channel.

Subsequently, when the user touches the user terminal 100 with a touch means such as a finger or a touch pen, the user terminal 100 detects the touch means through various methods (S204). Specifically, the user terminal 100 detects the touch means when the touch means touches the screen or touch pad of the touch panel. For example, the user terminal 100 may use a capacitive touch panel, and when the user touches the user terminal 100 with a finger, the user terminal 100 may detect a change in capacitance caused by the finger to detect a position of the finger. have. According to another embodiment of the present invention, the user terminal 100 may use a variety of methods, such as electromagnetic induction, resistive film, optical, ultrasonic method, in addition to the capacitive method, the setting conditions may vary depending on the usage method .

Subsequently, the user terminal 100 transmits a control signal including position information of the touch means according to the detection result to the receiving terminal 102 through a control channel, and the receiving terminal 102 transmits the control signal according to the control signal. A second image according to the location information, for example, a shadow image 400 as shown in FIG. 4 is displayed on the image (S206). In the above, signals are transmitted differently by being divided into a data channel and a control channel, but both image data and a control signal may be transmitted through the data channel. For example, the user terminal 100 sets a control section 112 between the data sections 110 and 114 as shown in FIG. 3B to control the signal C1 during the control section 112. Can transmit

Subsequently, when the user touches the user terminal 100 again using the touch means or moves to the touch state, the user terminal 100 generates a control signal including the position information of the touch means according to the movement to the receiving terminal 102. ), And the receiving terminal 102 displays the second image on the first image according to the transmitted control signal (S208). As a result, the second image is displayed and moved on the first image of the receiving terminal 102 to reflect the movement of the touch means. Of course, when the user clicks a menu for performing a specific operation on the first image on the user terminal 100, only image switching is performed, and thus, the receiving terminal 102 maintains the second image at the current position. Only an image may be changed into a new image of the user terminal 100.

In summary, the terminal interworking and control method of the present invention detects the touch of the touch means in the state in which the first image is shared and displays the second image on the first image of the receiving terminal 102, and the user selects the user terminal ( When the touch screen 100 is touched or moved in the touch state, the second image is displayed or moved at the corresponding position on the first image of the receiving terminal 102.

The first image and the second image displayed on the receiving terminal 102 may overlap as separate images, or a composite image generated by combining the first image and the second image may be displayed.

Although the second image is referred to as being displayed on the first image, the display method may be variously modified as long as the second image is displayed together with the first image. For example, a portion of the first image corresponding to the position of the touch unit may be darkly expressed, and the darkly expressed portion may be the second image.

Hereinafter, various methods of sensing the touch means will be described with reference to the accompanying drawings.

As a basic method of detecting the touch means, the display unit of the user terminal 100 is configured by a capacitive touch panel, and a touch means such as a finger, or the like, is used. In this case, the sensing unit of the user terminal 100 detects the position of the touch means by changing the capacitance when approaching and touching the touch means.

There are other methods of sensing the touch means, which will be described with reference to FIGS. 5 to 7 below.

5 is a diagram illustrating a touch means sensing method according to an embodiment of the present invention.

Referring to FIG. 5, the touch pen 500 may be used as a touch means for touching the user terminal 100. The user terminal 100 uses a capacitive touch panel.

The touch pen 500 includes a body 510 and a touch unit 512. Body 510 is made of a material that does not conduct electricity, the touch unit 512 is a conductor. Accordingly, when the touch pen 500 touches the user terminal 100 due to the touch unit 512, the capacitance changes, and the user terminal 100 detects the change in capacitance to position the touch pen 500. Detect. That is, unlike the general touch pen that could not be used in the capacitive method, the touch pen 500 of the present invention can be used in the capacitive method. Of course, the entire touch pen 500 may be made of a conductor. However, in consideration of cost, it is preferable to manufacture only the touch unit 512 that is actually touched with a conductor.

6 is a view showing a touch means detection method according to another embodiment of the present invention.

Referring to FIG. 6A, a receiver 600 may be mounted on a part of the user terminal 100, and a touch pen 602 may be used.

The receiver 600 may include one infrared sensor and two ultrasonic sensors. The receiver 600 may detect the movement of the touch pen 602 by receiving infrared rays and ultrasonic waves transmitted from the touch unit (tip) of the touch pen 602. The control signal having the position information of the touch pen 602 according to the detection result is transmitted to the receiving terminal 102. The receiving terminal 102 analyzes the control signal to detect the position of the touch pen 602 and displays a second image at the detected position. As a result, the second image is displayed together with the first image. In this case, the control signal may be transmitted by the receiver 600 to the receiving terminal 102 or the user terminal 100 may be transmitted to the receiving terminal 102.

Looking at how the receiver 600 detects the position of the touch pen 602, three sensors respectively measure the transmission time of the infrared ray and the transmission time of the ultrasonic wave, converts the transmission times into distances, and converts the converted distances. The position of the touch pen 602 is detected through a method similar to triangulation. Of course, signals other than infrared and ultrasonic may also be used.

The second image indicating the position of the touch pen 602 may be displayed only on the receiving terminal 102 without being displayed on the user terminal 100. Of course, the user terminal 100 operates in response to the movement of the touch pen 602.

According to another embodiment of the present invention, the receiver 600 not only detects the position of the touch pen 602 but also transmits an image signal and a control signal including image data to the receiving terminal 102. Can be. In detail, the receiver 600 may include a touch controller 610, an image signal unit 612, a control signal unit 614, and a transceiver unit 616. The touch controller 610 detects the position of the touch pen 602 by using the received infrared rays and ultrasonic waves, and provides information about the detected position to the user terminal 100. The user terminal 100 displays the location of the touch pen 602 or performs a related operation according to the provided information. The image signal unit 612 receives image data from the user terminal 100, and transmits the provided image data to the receiving terminal 102 through the transceiver 616. The control signal unit 614 transmits a control signal having information about the detected position of the touch pen 602 to the receiving terminal 102. That is, since the receiver 600 transmits a control signal having information on the position of the touch pen 602 and the image data transmitted from the user terminal 100 to the receiving terminal 102, the user terminal 100 is a communication function It is enough not to have. Accordingly, a terminal having no communication function or a terminal having a communication function but unable to use a related communication facility may not only recognize the position and operation of the touch pen 602 using the receiver 600 but also share an image and a second device. The interlocking method of the present invention, such as display of an image, can be used.

According to another embodiment of the present invention, the receiver may be included in the user terminal 100 to be integrally implemented.

7 is a diagram illustrating a touch means sensing method according to another embodiment of the present invention.

Referring to FIG. 7, the user terminal 100 includes a touch panel 700 and an electromagnetic generator 702.

The electromagnetic generator 702 may be formed on the rear surface of the touch panel 700, and may be formed of a thin metal film to generate an electromagnetic field when electricity flows.

The touch pen 707 includes a body 710 and a touch unit 712, and the touch unit 712 may be preferably made of a small metal coil. As a result, when the touch pen 704 is close to the touch panel 700, an electromagnetic induction phenomenon occurs in the touch unit 712, and as a result, a deformation of the electromagnetic field generated from the electromagnetic generator 702 occurs. Therefore, the user terminal 100 detects the deformation of the electromagnetic field and recognizes the position of the touch pen 704. In particular, since the deformation of the electromagnetic field is different according to the approach position and the touch intensity of the touch pen 704, the touch means sensing method may detect the touch pressure on the touch panel 700 of the touch pen 704 in detail. have. Therefore, the size of the second image displayed on the receiving terminal 102, the thickness of the line when represented by a line, and the like may be displayed differently according to the position or pressure of the touch pen 704. Of course, the shape, size or color of the second image may vary depending on the touch intensity.

5 to 7, the user terminal 100 may detect the touch pen through various methods and reflect the detection result to the receiving terminal 102.

Hereinafter, an operation of a terminal interworking system when using a touch means sensing method capable of sensing touch pressure will be described. However, the present invention is not limited to the method of FIG. 7, which is a method of detecting touch pressure, and may be variously modified.

According to an embodiment of the present invention, the user terminal 100 and the receiving terminal 102 may perform different operations according to the pressure level of the touch means. The user may execute a drawing application and draw a picture in various thicknesses of the user terminal 100 according to the touch pressure of the touch pen using the touch pen. In addition, for example, when the user touches the user terminal 100 below a preset pressure level while the user terminal 100 and the receiving terminal 102 interlock, the user terminal 100 may be a user terminal ( The location information of the touch pen which has touched 100, that is, the touch point may be transmitted to the receiving terminal 102. For example, when the user moves the touch pen while lightly touching or touching the display unit of the user terminal 100 with the touch pen, the user terminal 100 does not recognize the touch operation as selecting an icon or the like. The location information of the touch pen may be transmitted to the reception terminal 102 by recognizing the location information transmission operation. That is, when the touch pressure of the touch means is equal to or less than a preset pressure level, the user terminal 100 does not recognize the operation of the touch means as a touch for selecting an icon or the like displayed on the display unit, and receives only the position information of the touch means. Transmit to 102. On the other hand, when the user touches, for example, the display unit using the touch means more than the predetermined pressure, the user terminal 100 may recognize and process it as a touch for selecting an icon, for example.

In summary, when the user touches the user terminal 100 connected to the receiving terminal 102 to a predetermined pressure level or less using a touch means, that is, lightly touches the user terminal 100, the position of the touch means is displayed. The information may be transmitted to the receiving terminal 102, and the receiving terminal 102 may display location information of the touch means. In addition, when the user views only the receiving terminal 102 on which the location information of the touch means is displayed, the user places the touch means on an icon or an application to be selected by the user terminal 100 and then presses the pressure means over a preset pressure level, that is, strongly In the case of touching, the user terminal 100 may recognize the touch as a touch for selecting an icon or an application, and as a result, the icon or the application may be executed. In other words, the user may touch the user terminal 100 above a preset pressure level to select a corresponding icon, application, or the like.

In the above, the touch pressure level is divided into two and different operations are performed. However, the touch pressure levels may be separated into three or more pressure levels and different operations may be performed for each pressure level. For example, when the touch means touches the touch pressure below the first pressure level, the user terminal 100 transmits the position information of the touch means to the receiving terminal 102, and the first pressure level and the first pressure level. When touching between high second pressure levels, information indicating a drawing operation may be transmitted to the receiving terminal 102. When touching above the second pressure level, information indicating a selection operation such as an icon or an application may be transmitted. It may also transmit to the receiving terminal 102.

In addition, when the user touches the user terminal 100 above the preset pressure level, the position information of the touch means is transmitted to the receiving terminal 102, and when the user touches below the preset pressure level, selection of an icon, an application, or the like is performed. Information can also be sent to the receiving terminal 102.

According to another embodiment of the present invention, the user terminal 100 and the receiving terminal 102 may perform different operations according to the contact area of the touch means. The user may execute a drawing application and draw a picture in various thicknesses of the user terminal 100 according to the contact area between the touch pen and the user terminal 100 using the touch pen. In addition, for example, when the touch means is touched to the user terminal 100 below the preset contact area while the user terminal 100 and the receiving terminal 102 interlock, the user terminal 100 is the user terminal 100 ) May transmit the position information of the touch means touched, that is, the touch point, to the receiving terminal 102. On the contrary, when the touch means touches the user terminal 100 over a preset contact area, the user terminal 100 may recognize the touch operation as a general touch operation.

Here, the preset contact area is a concept similar to the preset pressure level described above. As the user terminal 100 transmits the position information of the touch means to the receiving terminal 102 according to the touch pressure of the touch means, the position information of the touch means is transmitted to the receiving terminal 102 according to the touch area of the touch means. Can be. In this case, the touch means may be a touch pen in which the pen tip enters the pen according to a finger of a person and pressure.

8 is a flowchart illustrating a terminal interworking and control method according to a second embodiment of the present invention.

Referring to FIG. 8, the user terminal 100 and the receiving terminal 102 are connected to start interlocking (S800).

Subsequently, the user terminal 100 transmits image data corresponding to the currently displayed first image to the receiving terminal 102, and the receiving terminal 102 displays the first image corresponding to the image data (S802). . That is, the user terminal 100 and the receiving terminal 102 share the first image.

Subsequently, the user terminal 100 detects a touch means such as a finger or a touch pen through various methods (S804).

Subsequently, the user terminal 100 generates a composite image displaying a second image corresponding to the position of the sensed touch means on the currently displayed first image, and receives composite image data corresponding to the composite image from a receiving terminal ( In step S806, the receiving terminal 102 displays the synthesized image corresponding to the synthesized image data. As a result, the fisheries terminal 102 displays a screen on which the second image is displayed together with the first image. In this case, only the first image may be displayed on the user terminal 100, or a screen on which the second image is displayed together with the first image may be displayed.

Subsequently, when the user touches the user terminal 100 again with the touch means or moves in the touched state, the user terminal 100 receives the composite image data corresponding to the synthesized image in which the position of the touch means is displayed. In step S808, the receiving terminal 102 displays a composite image corresponding to the composite image data. That is, the movement of the touch means is reflected on the screen of the receiving terminal 102.

In summary, unlike the first embodiment in which the receiving terminal 102 generates the second image and displays the second image together, in the present embodiment, the user terminal 100 synthesizes the first image and the second image. A composite image is generated and the generated composite image is transmitted to the receiving terminal 102. As a result, the receiving terminal 102 displays a screen on which the second image is displayed together with the first image.

9 is a flowchart illustrating a terminal interworking and control method according to a third embodiment of the present invention.

9, the user terminal 100 and the receiving terminal 102 are connected to start interlocking (S900). The interworking may be automatically started when the user terminal 100 and the receiving terminal 102 are connected, or may be started depending on the user's selection, asking whether the user is selected.

Subsequently, the user terminal 100 detects a position of a touch means such as a finger or a touch pen (S902).

Subsequently, according to the location information of the touch means transmitted from the user terminal 100, the receiving terminal 102 displays a second image corresponding to the position of the touch means (S904).

Subsequently, it is determined whether there is a request for interlocking stop or a setting change request by the user (S906). The request to stop interlocking or setting change may be requested by a user by selecting a menu or by turning off the connection between the user terminal 100 and the receiving terminal 102. When the user controls the user terminal 100 while viewing the receiving terminal 102 and wants to use only the user terminal 100 or only wants to view the receiving terminal 102, the user terminal 100 and the receiving terminal 102 You can request to stop interlocking while connected. In addition, the user may request a setting change so that the second image is not displayed on the receiving terminal 102 during interworking.

If there is no request for the user to stop interlocking or changing the setting, step S904 is performed again.

On the other hand, if there is a request for the user to stop interlocking or setting change, the first image transmission may be stopped or the setting may be changed (S908).

In summary, in the terminal interworking and control method of the present invention, a user may arbitrarily perform a linkage request, a linkage stop request, and a setting change.

10 is a diagram illustrating a terminal interworking system according to another embodiment of the present invention.

Referring to FIG. 10, the user terminal 100 and the receiving terminal 102 interlock with each other, that is, display the second image 1000 indicating the position of the touch means while sharing the first image. However, when the first image is shared, the receiving terminal 102 transmits image data to the user terminal 100 to share the first image.

When the receiving terminal 102 is an IPTV, as shown in FIG. 10, user interfaces (1010s) for selecting a program such as a movie or a drama may be displayed, and the first image on which the UIs 1010 are displayed may be displayed. It may be shared with the user terminal 100. Of course, the second terminal 1000 is displayed on the receiving terminal 102 together with the first image.

Looking at the advantages of sharing the first image displayed on the receiving terminal 102 to the user terminal 100, the user is watching the receiving terminal 102, for example TV, the user terminal 100, for example smart The phone can be used to control the operation on the receiving terminal 102. For example, the user may use the user terminal 100 to select a specific program, send an e-mail, perform an e-commerce transaction, or play a game through the reception terminal 102.

In addition, since the same first image as that of the receiving terminal 102 is displayed on the user terminal 100, the user may use the user terminal 100 to receive the screen of the receiving terminal 102. You can enjoy various services provided. For example, the user may control the receiving terminal 102 in the living room from the room to perform electronic commerce or the like.

11 is a flowchart illustrating a terminal interworking and control method according to a fourth embodiment of the present invention.

Referring to FIG. 11, the user terminal 100 and the receiving terminal 102 are connected to start interlocking (S1100).

Subsequently, the receiving terminal 102 transmits the image data corresponding to the first image currently displayed or the first image to be displayed to the user terminal 100, and the user terminal 100 transmits the image data corresponding to the transmitted image data. 1 Display an image on the screen (S1102). That is, the user terminal 100 and the receiving terminal 102 share the first image.

Subsequently, when the user touches the user terminal 100 with a touch means such as a finger or a touch pen, the user terminal 100 detects the touch means (S1104). The user terminal 100 may detect the touch means by using various methods such as a capacitance sensing method and an electromagnetic sensing method.

Subsequently, the user terminal 100 transmits a control signal having the position information of the touch means to the receiving terminal 102 according to the detection result, and the receiving terminal 102 is connected with the first image according to the transmitted control signal. Together, a second image indicating the position of the touch means is displayed (S1106). According to another exemplary embodiment of the present invention, the user terminal 100 may transmit the composite image data corresponding to the composite image in which the second image is displayed on the first image to the receiving terminal 102. However, since the receiving terminal 102 basically transmits the image data corresponding to the first image to the user terminal 100, the user terminal 100 transmits the control signal to the receiving terminal 102. The manner is preferred.

Subsequently, when the user touches the touch means again or moves in the touched state, the user terminal 100 transmits a control signal having the position information of the touch means to the receiving terminal 102 to the second receiving terminal 102. The image is displayed (S1108).

12 is a diagram illustrating a terminal interworking system according to another embodiment of the present invention.

Referring to FIG. 12A, in the terminal interworking system of the present invention, the receiver 1200 may be installed or embedded in the receiving terminal 102 instead of the user terminal 100.

When the touch pen 1202 transmits ultrasonic waves and infrared rays to the receiver 1200 installed in the receiving terminal 102 as a touch means used in the user terminal 100, the receiver 1200 receives the ultrasonic waves and infrared rays and touch pens. Detects the position of 1202.

The receiver 1200 transmits information on the detected position of the touch pen 1202 to the receiving terminal 102, and the receiving terminal 102 transmits a second image indicating the position of the touch pen 1202 to the first terminal. Display with the image. Of course, the user terminal 100 and the receiving terminal 102 display the second image in a state in which the first image is shared.

According to another embodiment of the present invention, the receiver 1200 may perform not only the position detection of the touch pen 1202 but also a communication role. In detail, the receiver 1200 may include a touch means detector 1210, an image signal unit 1212, a control signal unit 1214, and a transceiver 1216. The touch means detector 1210 detects the position of the touch pen 1202. The image signal unit 1212 receives an image signal that has delivered image data transmitted from the user terminal 100 through the transceiver 1216, and receives image data of the received image signal through the transceiver 1216. Send to 102 to display the first image. Of course, the image signal unit 1212 may receive the image data from the receiving terminal 102 and transmit the image signal that has distributed the received image data to the user terminal 100. The control signal unit 1214 may receive a control signal related to an interlocking operation and the like transmitted from the user terminal 100 and transmit the received control signal to the receiving terminal 102. Of course, the control signal having information about the position of the touch pen 1202 is not transmitted from the user terminal 100 to the receiver 1200. In conclusion, the receiver 1200 not only detects the position of the touch pen 1202 but also performs a communication function. Therefore, the receiving terminal 102 can use the interworking and control method of the present invention without having a communication function.

13 is a flowchart illustrating a terminal interworking and control method according to a fifth embodiment of the present invention.

Referring to FIG. 13, the receiver 1200 is installed in the receiving terminal 102 (S1300). According to another embodiment of the invention, the receiver may be embedded in the receiving terminal 102.

Subsequently, the user terminal 100 and the receiving terminal 102 are connected to start interlocking (S1302).

Subsequently, the user terminal 100 transmits image data corresponding to the first image to the receiving terminal 102 to share the first image, or the receiving terminal 102 transmits the image data to the user terminal 100. The first image is shared (S1304).

Subsequently, when the touch means, for example, the touch pen 1202 touches the user terminal 100, the receiver 1200 detects the position of the touch pen 1202 through infrared rays and ultrasonic waves transmitted from the touch pen 1202. The transmission is transmitted to the reception terminal 102, and the reception terminal 102 displays a second image such as a shadow according to the detected position together with the first image (S1306).

Subsequently, when the user touches the user terminal 100 again with the touch pen 1202 or moves after touching, the receiver 1200 detects the movement of the touch pen 1202 and transmits the movement to the receiving terminal 102. The terminal 102 displays the corresponding second image together with the first image according to the movement (S1308).

14 is a diagram illustrating a terminal interworking system according to another embodiment of the present invention.

Referring to FIG. 14A, the terminal interworking system according to the present embodiment includes a user terminal 100, a receiving terminal 102, and a dongle 1400.

The dongle 1400 serves not only to assist communication of the user terminal 100 but also to sense the position of the touch pen 1402 as a touch means. Specifically, the dongle 1400 may include a communication unit 1410 and a touch means detector 1412.

The communication unit 1410 is a communication means for the user terminal 100, and may provide a specific communication function, for example, a Wibro communication function, and converts the specific communication function into another communication function, for example, Wi- It may be converted to Fi and used for the user terminal 100.

The touch means detector 1412 may detect the position of the touch pen 1402 similarly to the receiver, and may transmit information about the detected position to the receiving terminal 102 through a control signal.

In summary, the user terminal 100 has a communication function through the dongle 1400, and the dongle 1400 is also used as a means for detecting the position of the touch pen 1402.

Hereinafter, a receiver and a dongle in the case of being separated from the user terminal 100 will be collectively referred to as an external device.

15 is a block diagram showing the structure of a user terminal according to an embodiment of the present invention.

Referring to FIG. 15, the user terminal 100 of the present embodiment includes a control unit 1500, an interlocking unit 1502, an image unit 1504, a sensing unit 1506, a setting unit 1508, a display unit 1510, A signal unit 1512, a transceiver 1514, and a storage unit 1516 are included.

The interlocking unit 1502 manages all functions related to interworking with the receiving terminal 102.

The image unit 1504 may generate a first image to be shared with the receiving terminal 102 or generate a composite image of the second image and the first image. The image unit 1504 displays the first image through the display unit 1510.

The sensor 1506 detects a touch means such as a finger or a touch pen. Specifically, the sensing unit 1506 detects the position of the touch means by distinguishing when the touch means is touched again when the touch means touches. The sensing method is not limited, such as capacitive and electromagnetic induction.

The setting unit 1508 manages setting of various functions such as setting of an interworking function.

The display unit 1510 is a touch panel and may be implemented in various ways, such as a capacitive type, a resistive film type, and an electromagnetic induction type.

The signal unit 1512 generates an image signal for distributing image data corresponding to the first image and a control signal having position information of the touch means. In addition, the signal unit 1512 may transmit the image signal to the receiving terminal 102 through the data channel and the control signal to the receiving terminal 102 through the control channel.

The transceiver unit 1514 serves as a communication path with the receiving terminal 102.

The storage unit 1516 stores various data such as a first image, an image signal, a control signal, an application program, and the like.

The controller 1500 generally controls the operations of the components of the user terminal 100.

FIG. 16 is a block diagram illustrating a structure of the image unit of FIG. 15 according to an embodiment of the present invention. FIG.

Referring to FIG. 16, the image unit 1504 of the present embodiment includes a first image generator 1600, a second image generator 1602, and an image synthesizer 1604.

The first image generator 1600 generates a shared first image, and the second image generator 1602 generates a second image such as a shadow image corresponding to the position of the touch means.

The image synthesizer 1604 generates a composite image on which the second image is displayed along with the generated first image.

According to another embodiment of the present invention, the user terminal 100 transmits an image signal that has delivered image data corresponding to the first image to the receiving terminal 102, and is not a control signal having information on the position of the touch means. The control signal in which the position indication data corresponding to the second image is distributed may be transmitted to the receiving terminal 102.

17 is a block diagram showing the structure of a user terminal according to a second embodiment of the present invention. 17 illustrates a structure of a user terminal 100 in a terminal interworking system in which a receiver is installed in the user terminal 100.

Referring to FIG. 17, the user terminal 100 according to the present embodiment includes a control unit 1700, an interlocking unit 1702, an image unit 1704, a touch unit 1706, a setting unit 1708, and a display unit 1710. It may include a signal unit 1712, a transceiver 1714, and a storage 1716.

Hereinafter, descriptions of the components that perform the same functions as those in the first embodiment will be omitted.

The image unit 1704 generates a first image to be shared with the receiving terminal 102 or generates a composite image of the first image and the second image.

The touch manager 1706 receives and manages information on the position of the touch means from the receiver. That is, the receiver detects the position of the touch means, and the touch manager 1706 detects the position of the touch means by analyzing a signal transmitted from the receiver.

The signal unit 1712 generates an image signal that delivers image data corresponding to the first image, a control signal having information about a position of the touch means, or a synthesized signal that distributes data corresponding to a composite image. In addition, the signal unit 1712 may transmit the image signal or the composite signal to the receiving terminal 102 through a data channel and transmit the control signal to the receiving terminal 102 through a control channel.

18 is a block diagram showing the structure of a user terminal according to a third embodiment of the present invention. 18 illustrates a structure of a user terminal 100 in a terminal interworking system in which a receiver is embedded in the user terminal 100.

Referring to FIG. 18, the user terminal 100 of the present embodiment includes a control unit 1800, an interlocking unit 1802, a transceiver 1804, an image unit 1806, a receiver unit 1808, a setting unit 1810, and the like. The display unit 1812, the signal unit 1814, and the storage unit 1816 may be included.

Hereinafter, descriptions of the components that perform the same functions as those in the first embodiment will be omitted.

The image unit 1806 generates a first image to be shared with the receiving terminal 102 or generates a composite image of the first image and the second image.

The receiver 1808 receives infrared rays and ultrasonic waves transmitted from the touch means when the touch means touches the user terminal 100, and analyzes the received infrared rays and ultrasonic waves to detect the position of the touch means.

The signal unit 1814 generates an image signal for distributing image data corresponding to the first image, a control signal having information about the position of the touch means, or a synthesized signal for distributing composite image data corresponding to the composite image. In addition, the signal unit 1814 may transmit the image signal or the synthesized signal to the receiving terminal 102 through the data channel, and transmit the control signal to the receiving terminal 102 through the control channel.

19 is a block diagram showing the structure of a user terminal according to a fourth embodiment of the present invention. 19 illustrates a structure of a user terminal 100 using an electromagnetic induction method.

Referring to FIG. 19, the user terminal 100 of the present embodiment may include a control unit 1900, an interlocking unit 1902, an image unit 1904, an electromagnetic generator 1906, a detection unit 1908, and a setting unit 1910. The display unit 1912 may include a signal unit 1914, a transceiver 1916, and a storage unit 1920.

Hereinafter, descriptions of the components that perform the same functions as those in the first embodiment will be omitted.

The image unit 1904 generates a first image to be shared with the receiving terminal 102 or generates a composite image of the first image and the second image.

The electromagnetic generator 1906 serves to generate electromagnetic waves in order to sense the touch means by an electromagnetic induction method, and may be disposed on the rear surface of the display unit 1912.

The sensing unit 1908 senses the position of the touch means by sensing the electromagnetic change caused by the coil of the touch means.

The signal unit 1914 generates an image signal for distributing image data corresponding to the first image, a control signal having information on the position of the touch means, or a synthesized signal for distributing data corresponding to the synthesized image. In addition, the signal unit 1914 may transmit the image signal or the synthesized signal to the receiving terminal 102 through the data channel and the control signal to the receiving terminal 102 through the control channel.

20 is a block diagram showing the structure of a user terminal according to a fifth embodiment of the present invention. 20 illustrates the structure of the user terminal 100 when the receiving terminal 102 transmits image data to the user terminal 100.

Referring to FIG. 20, the user terminal 100 of the present embodiment includes a control unit 2000, an interlocking unit 2002, a transceiver unit 2004, an image signal unit 2006, an image unit 2008, and a detection unit 2010. , A signal unit 2012, a display unit 2014, a setting unit 2016, and a storage unit 2018.

Hereinafter, descriptions of the components that perform the same functions as those in the first embodiment will be omitted.

The image signal unit 2006 receives an image signal transmitted from the receiving terminal 102 through the transceiver 2004 and analyzes the received image signal.

The image unit 2008 generates a first image corresponding to the image signal analyzed by the image signal unit 2006 or generates a composite image of the first image and the second image.

The detector 2010 detects the position of the touch means.

The signal unit 2012 generates an image signal in which data corresponding to a control signal or a composite image having information about the position of the touch unit is distributed. In addition, the signal unit 1914 may transmit the image signal to the receiving terminal 102 through the data channel and the control signal to the receiving terminal 102 through the control channel.

21 is a block diagram showing the structure of a receiving terminal according to the first embodiment of the present invention.

The receiving terminal 102 of the present embodiment includes a control unit 2100, an interlocking unit 2102, a transmitting and receiving unit 2104, an image signal unit 2106, a control signal unit 2108, an image unit 2110, and a display unit 2112. ) And a storage unit 2114.

The linkage unit 2102 manages a linkage function with the user terminal 100.

The transceiver 2104 serves as a communication path of the user terminal 100.

The image signal unit 2106 receives an image signal that has delivered image data transmitted from the user terminal 100, and analyzes the received image signal to detect image data.

The control signal unit 2108 receives a control signal transmitted from the user terminal 100 and analyzes the received control signal to detect information on the position of the touch means.

The image unit 2110 displays the first image corresponding to the detected image data through the display unit 2112 and, together with the first image, a shadow corresponding to the information on the position of the detected touch means. Display the second image. According to another embodiment of the present invention, the image unit 2110 generates a composite image in which the second image is displayed together with the first image through the image data and the information, and displays the generated composite image. Display via 2112.

The display unit 2114 may be implemented with various display elements such as LCD, OLED, PDP, etc. without limiting to display an image, and does not need to have a touch function.

The storage unit 2114 stores various data such as a first image, a second image, a composite image, an application program, and the like.

The controller 2100 generally controls the operations of the components of the receiving terminal 102.

22 is a block diagram showing the configuration of a receiving terminal according to a second embodiment of the present invention. FIG. 22 shows the structure of the receiving terminal 102 when the composite image is transmitted from the user terminal 100 to the receiving terminal 102.

Referring to FIG. 22, the reception terminal 102 of the present embodiment includes a control unit 2200, an interlocking unit 2202, a transceiver 2204, a signal unit 2206, an image unit 2208, a display unit 2210, and the like. It may include a storage unit 2212.

Hereinafter, detailed description of the same components as in the first embodiment will be omitted.

The signal unit 2206 receives the image signal and the synthesized signal from the user terminal 100, and analyzes the received image signal and the synthesized signal. The signal unit 2206 receives the image signal at the start of interlocking, and receives a composite signal when the user terminal 100 detects the touch means. The composite signal includes data corresponding to the composite image of the first image and the second image. According to another embodiment of the present invention, the signal unit 2206 may receive a composite signal that has delivered the composite image data and a control signal that has distributed the data corresponding to the second image.

The image unit 2208 displays the synthesized image corresponding to the data included in the synthesized signal through the display unit 2210. As a result, the reception terminal 102 displays a screen on which the second image is displayed together with the first image. According to another exemplary embodiment of the present disclosure, the image unit 2208 may display the first image corresponding to the image data through the display unit 2210 and display the second image together with the first image.

23 is a block diagram showing the configuration of a receiving terminal according to a third embodiment of the present invention. 23 shows the structure of the receiving terminal 102 when the receiver is installed in the receiving terminal 102.

Referring to FIG. 23, the receiving terminal 102 of the present embodiment includes a control unit 2300, an interlocking unit 2302, a transceiver 2304, a signal unit 2306, a receiver unit 2308, an image unit 2310, The display unit 2312 and the storage unit 2314 may be included.

Hereinafter, detailed description of the same components as in the first embodiment will be omitted.

The signal unit 2306 receives an image signal from which the image data has been distributed from the user terminal 100 and analyzes the received image signal.

The receiver unit 2308 receives and analyzes information on the position of the touch means from the receiver installed in the receiving terminal 102.

The image unit 2310 displays a first image corresponding to the image data through the display unit 2312, and displays a second image corresponding to the position of the touch unit together with the first image. According to another embodiment of the present invention, the image unit 2310 generates a composite image of the first image and the second image, and displays the generated composite image through the display unit 2312.

24 is a block diagram showing a configuration of a receiving terminal according to a fourth embodiment of the present invention. 24 shows the structure of the receiving terminal 102 when the receiver is built in the receiving terminal 102.

Referring to FIG. 24, the reception terminal 102 of the present embodiment includes a control unit 2400, an interlocking unit 2402, a transceiver 2404, a signal unit 2406, a receiver unit 2408, an image unit 2410, It may include a display unit 2412 and a storage unit 2414.

Hereinafter, detailed description of the same components as in the first embodiment will be omitted.

The receiver 2408 detects the position of the touch means by detecting infrared rays and ultrasonic waves transmitted from the touch means touching the user terminal 100.

The image unit 2410 displays the first image corresponding to the image data through the display unit 2412, and the second image corresponding to the position of the touch means detected by the receiver unit 2408 together with the first image. Display the image. According to another embodiment of the present invention, the image unit 2410 generates a composite image of the first image and the second image, and displays the generated composite image through the display unit 2312.

25 is a block diagram showing a configuration of a receiving terminal according to a fifth embodiment of the present invention. 25 shows the structure of the receiving terminal 102 when the receiving terminal 102 transmits the image data to the user terminal 100.

Referring to FIG. 25, the reception terminal 102 of the present embodiment includes a control unit 2500, an interlocking unit 2502, a signal unit 2504, an image unit 2506, a display unit 2508, a transceiver unit 2510, and the like. The storage unit 2512 may be included.

Hereinafter, detailed description of the same components as in the first embodiment will be omitted.

The signal unit 2504 generates an image signal in which image data corresponding to the first image to be displayed or displayed on the receiving terminal 102 is distributed, and the generated image signal is transmitted to the user terminal 100 through the transceiver unit 2510. To send). In addition, the signal unit 2504 receives and analyzes the information on the position of the touch means transmitted from the user terminal 100 or the control signal having data corresponding to the second image or the synthesized signal that has distributed the data for the synthesized image. .

The image unit 2506 generates a second image corresponding to the position of the touch means, and displays the second image together with the first image through the display unit 2508. According to another embodiment of the present invention, the image unit 2506 may generate a composite image of the first image and the second image, and display the generated composite image through the display unit 2508.

The embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art having ordinary knowledge of the present invention may make various modifications, changes, and additions within the spirit and scope of the present invention. Should be considered to be within the scope of the following claims.

100: user terminal 102: receiving terminal
400: second image 500: touch pen
600: receiver 602: touch pen
700: touch panel 702: electromagnetic generator
704: touch pen 1000: the second image
1010: UI 1200: Receiver
1202: Touch Pen 1400: Dongle
1402: touch pen

Claims (25)

In the user terminal used in the terminal interworking system,
An image unit having a size larger than that of the user terminal and outputting image data corresponding to a first image to be shared with a receiving terminal viewed by a user of the user terminal; And
It includes a signal unit for transmitting the image data output from the image unit and the position information of the touch means for touching the user terminal to the receiving terminal,
The location information is location information of the touch means which touches the user terminal at a predetermined pressure level or contact area or less, and is displayed on the receiving terminal in the form of an image. delete The method of claim 1, wherein at least one of a shape, a size, and a color of the second image displayed on the receiving terminal according to the transmitted location information is different depending on the touch intensity of the touch means with respect to the user terminal. User terminal used in the terminal interworking system. The method of claim 1,
An interlocking unit managing an interworking between the user terminal and the receiving terminal; And
Further comprising a setting unit for managing the settings related to the interworking,
And the setting unit changes at least one setting in a state in which the user terminal and the receiving terminal are interworked. delete delete According to claim 1, wherein the user terminal further comprises a touch means, the user terminal is a receiver is installed,
The receiver detects the position of the touch means by detecting the ultrasonic wave and infrared rays transmitted from the touch means, and the signal unit controls the receiver to transmit the position information to the receiving terminal. User terminal used. The method of claim 1,
A display unit configured to display a first image corresponding to the image data output from the image unit;
An electromagnetic generator attached to a rear surface of the display unit and configured to generate electromagnetic waves; And
Further comprising a detector,
A metal coil is wound around the end of the touch means, an electromagnetic induction phenomenon occurs in the metal coil by the generated electromagnetic, the electromagnetic is deformed by the electromagnetic induction phenomenon, and the sensing unit detects the modified electromagnetic. User terminal used in the terminal interworking system, characterized in that for detecting the position of the touch means. delete delete In the user terminal used in the terminal interworking system,
An image having a larger size than the user terminal and including a first image to be shared with a receiving terminal viewed by a user of the user terminal and a second image indicating the position of the touch means when the touch means touches the user terminal. An image unit for outputting data; And
A signal unit for transmitting the image data output from the image unit to the receiving terminal,
The position of the touch means is a position of the touch means which touches the user terminal at a preset pressure level or contact area or less, and the first image and the second image are displayed on the receiving terminal. User terminal used in the system. The method of claim 11,
The user terminal used in the terminal interworking system, characterized in that it further comprises a sensing unit for detecting a touch of the touch means. 12. The method of claim 11, wherein at least one of a shape, a size, and a color of the second image displayed on the receiving terminal according to the transmitted image data is different depending on the touch intensity of the touch means with respect to the user terminal. User terminal used in the terminal interworking system. The method of claim 11, wherein the user terminal,
An interlocking unit managing an interworking between the user terminal and the receiving terminal; And
Further comprising a setting unit for managing the settings related to the interworking,
And the setting unit changes at least one setting in a state in which the user terminal and the receiving terminal are interworked. delete delete delete delete delete In the user terminal used in the terminal interworking system,
A display unit; And
It includes a signal unit for transmitting the image information and the location information of the touch means for touching the user terminal to a receiving terminal having a larger size than the user terminal and viewed by the user of the user terminal,
The location information is location information of the touch means for touching the user terminal to a predetermined pressure level or contact area or less, and is displayed on the receiving terminal in the form of an image. 21. The method of claim 20,
The user terminal further comprises a sensing unit for sensing a touch of the touch means. delete In the user terminal used in the terminal interworking system,
A display unit; And
And a signal unit for transmitting the composite image data to a receiving terminal that is larger in size than the user terminal and is viewed by a user of the user terminal.
The composite image data includes first image data and second image data about a position of a touch means that touches the user terminal, and the position of the touch means touches the user terminal below a predetermined pressure level or contact area. And a second image corresponding to the first image data and a second image corresponding to the second image data are displayed on the receiving terminal. 24. The method of claim 23,
The user terminal further comprises a sensing unit for sensing a touch of the touch means. delete

Images