KR20200012076A - Method and Apparatus for Two-way Touch-Screen Based on Multi-Touch Panel - Google Patents

Abstract

Disclosed are a two-way touch screen device and method based on a multi-touch panel which use a display terminal having at least two multi-touch panels loaded thereon to share touch information with a different terminal. According to embodiments of the present invention, the two-way touch screen device based on a multi-touch panel comprises: a coordinate data acquisition unit to recognize at least one touch signal inputted into at least one touch panel among multi-touch panels of a user terminal to acquire coordinate data; a coordinate data merging unit to merge and process the at least one touch signal to generate first touch information; a coordinate data conversion unit to acquire a third touch signal from a touch panel arranged on at least one different terminal, and convert coordinate data of the third touch signal to be applicable to the multi-touch panels to generate third touch information; a coordinate panel determination unit to determine at least one touch panel corresponding to the third touch information among the multi-touch panels; and an image data processing unit to process image data outputted by the user terminal based on the coordinate data of at least one of the first touch information and the third touch information.

Description

Interactive touch screen device based on multi-touch panel and method therefor {Method and Apparatus for Two-way Touch-Screen Based on Multi-Touch Panel}

The present invention relates to a multi-touch panel based interactive touch screen device and a method therefor. More particularly, the present invention relates to a multi-touch panel-based bidirectional touch screen device and a method therefor for sharing touch information with another device using at least two touch panels.

The contents described in this section merely provide background information on the embodiments of the present invention and do not constitute a prior art.

A two-way touch system refers to a system in which two or more different terminals share image information and touch information. Conventional two-way touch systems operate by incorporating touch information into image data to share this image data.

The conventional two-way touch system has to be built as a high-end system because the size of the image data itself is very large, it takes a lot of time for one terminal to transmit the image data to the other terminal when built in a low-specific system . Accordingly, the conventional bidirectional touch system has a problem that a data transmission delay phenomenon occurs. In addition, if the communication state between the different terminals is poor, there is a problem that the phenomenon caused by the traffic.

On the other hand, in the trend of increasing the size of the display for outputting the image is a conventional two-way touch system using a single touch panel is a slow touch recognition speed. In particular, in the case of a display device of 100 inches or more, the manufacturing process for implementing a single touch panel is very difficult and mass production is also very inferior. Accordingly, there is a need for a method for solving a problem of a single touch panel while improving touch speed in a large display device.

The present invention has a main object to provide a multi-touch panel-based interactive touch screen device and a method therefor for sharing touch information with another terminal using a display terminal equipped with at least two multi-touch panels.

According to an aspect of the present invention, a multi-touch panel-based bidirectional touch screen device for achieving the above object is to recognize the coordinate data by recognizing at least one touch signal input to at least one touch panel of the multi-touch panel of the terminal. Acquiring coordinate data acquisition unit; A coordinate data merging unit which merges the at least one touch signal to generate first touch information; A coordinate data conversion unit for acquiring a third touch signal from a touch panel provided in at least one other terminal and converting coordinate data of the third touch signal to be applicable to the multi-touch panel to generate third touch information; A coordinate panel determiner configured to determine at least one touch panel corresponding to the third touch information among the multi-touch panels; And an image data processor configured to process image data output from the own terminal based on at least one coordinate data of the first touch information and the third touch information.

According to another aspect of the present invention, the multi-touch panel-based touch information processing method for achieving the above object is to recognize at least one touch signal input to at least one touch panel of the multi-touch panel of the own terminal A coordinate data obtaining step of obtaining coordinate data; A coordinate data merging step of merging the at least one touch signal to generate first touch information; A coordinate data conversion step of acquiring a third touch signal from a touch panel provided in at least one other terminal, and generating third touch information by converting coordinate data of the third touch signal to be applicable to the multi-touch panel; A coordinate panel determining step of determining at least one touch panel corresponding to the third touch information among the multi-touch panels; And an image data processing step of processing image data output from the own terminal based on at least one coordinate data of the first touch information and the third touch information.

The present invention can achieve the following effects through the configuration for achieving the above object.

First, since the touch information is generated as coordinate data instead of image data, the size of the data itself can be reduced, thereby reducing the time required to transmit the touch information to another terminal.

Second, even if a plurality of terminals share the touch information, the data transmission delay may be prevented, and even if the communication state is poor, the lag due to the traffic may be minimized by reducing the data transmission amount.

Third, since the touch information is shared between different terminals, it is possible to provide a convenience that a plurality of people can work simultaneously on one screen.

Fourth, by applying at least two touch panels, it is possible to implement an extra large display terminal.

Fifth, by constructing a large touch panel to which two touch panels are applied, the data processing speed can be maintained quickly even when a large number of people touch.

1 is a conceptual diagram of a display system according to an exemplary embodiment of the present invention.
2 is a detailed view of a display system according to an embodiment of the present invention.
3 is a first reference diagram for describing a touch information processing operation of a terminal having a multi-touch panel in a display system according to an exemplary embodiment of the present invention.
4 is a second reference diagram for describing a touch information processing operation of a terminal having a multi-touch panel in a display system according to an exemplary embodiment of the present invention.
5 is a flowchart illustrating a case of operating in both directions in the display system according to an exemplary embodiment of the present invention.
6 is a flowchart illustrating a case of operating in one direction in the display system according to an exemplary embodiment of the present invention.
7 is a reference diagram for describing a method of processing touch information in non-real time in a display system according to an exemplary embodiment of the present invention.
8 is a reference diagram for describing a method of processing touch information in real time in a display system according to an exemplary embodiment of the present invention.
9 is a conceptual diagram schematically illustrating an interactive touch screen device according to an exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, preferred embodiments of the present invention will be described below, but the technical spirit of the present invention is not limited thereto, but may be variously modified and modified by those skilled in the art.

The present invention relates to a bidirectional touch screen device having at least two touch panels capable of two-way communication and a method therefor. Hereinafter, the present invention will be described in detail with reference to the drawings.

1 is a conceptual diagram of a display system according to an exemplary embodiment of the present invention.

The display system 100 proposed in the present invention is a display system composed of terminals equipped with a bidirectional touch interface, and the display terminals 110, 120, 130, 140, and 150 equipped with a touch panel are displayed as one display terminal. It is a system that provides a solution that can be used by a large number of people.

The display terminals 110, 120, 130, 140, and 150 may be terminals equipped with a multi-touch panel. In particular, the display terminals 110, 120, 130, 140, and 150 may be equipped with at least two touch panels to improve the touch processing speed. It is desirable to. For example, the large display terminal 110 having a size of 100 inches or more includes at least two multi-touch panels, and the large display terminal 110 allows touch information to be processed through interworking between the two multi-touch panels.

The display terminals 110, 120, 130, 140, and 150 are connected to each other in a wired or wireless manner through a wireless display (WiDi), a mobile high-definition link (MHL), a bluetooth, a USB, and the like. Share your back. The display terminals 110, 120, 130, 140, and 150 operate by bidirectionally communicating touch information with coordinate data instead of image data.

2 is a detailed view of a display system according to an embodiment of the present invention.

The display system 100 proposed in the present invention includes a plurality of display terminals such as a first display terminal 210, a third display terminal 230, and a fourth display terminal 240.

In the example of FIG. 2, three terminals are presented as display terminals included in the display system 100, but the number of display terminals included in the display system 100 of the present invention may be changed according to an exemplary embodiment. In addition, although the display system 100 of the present invention describes that the second display terminal does not exist, this is to maintain the terminology of the components included in the display terminal. Can be.

The first display terminal 210 is a terminal equipped with a multi-touch panel and serving as a master in the display system 100, and may be a display terminal having a resolution of a predetermined size or more. In the present embodiment, it is assumed that the first display terminal 210 has a multi-touch panel including two touch panels, and the number of touch panels included in the multi-touch panel may be changed.

The first display terminal 210 includes a first display panel 211, a first touch panel 212, a first image I / F 213, a first touch I / F 214, and a first touch C / B. 215, a second display panel 221, a second touch panel 222, a second touch I / F 224, a second touch C / B 225, and the like. In the present invention, the first display terminal 210 is set as a terminal to play a master role, but in this embodiment, only the first display terminal 210 does not play a master role.

The first display panel 211 outputs image data and the like from the first display terminal 210. The first display panel 211 may share image information with the third display terminal 230, the fourth display terminal 240, and the like through the first image I / F 213.

The first touch panel 212 and the second touch panel 222 mean a touch sensor that receives a touch signal from the first display terminal 210. The first touch panel 212 and the second touch panel 222 may include a first touch I / F 214, a first touch C / B 215, a second touch I / F 224, and a second touch C. The touch signal is transmitted to the first control module 226 through the / B 225, and the touch information merged through the first control module 226 is transmitted to the third display terminal 230 and the fourth display terminal 240. ) And so on.

The first image I / F 213 performs an interface function and performs a function of mutually connecting the first display panel 211 with other display terminals 230 and 240 so that image information can be shared. .

The first touch I / F 214 and the second touch I / F 224 perform an interface function, and the first touch panel 212 can share touch information through the first control module 226. And a multi-touch panel including the second touch panel 222 and mutually communicating with other display terminals 230 and 240. Here, the first touch I / F 214 and the second touch I / F 224 are described as separate modules, but are not necessarily limited thereto, and may be integrated into one module according to an embodiment. .

The first touch C / B 215 performs a function of acquiring coordinate data related to the touch as a touch signal when a user's touch is input to the first touch panel 212. To this end, the first touch C / B 215 may include a controller board and an OS board connected to the first touch panel 212 to drive a touch.

The second touch C / B 225 performs a function of acquiring coordinate data related to the touch as a touch signal when a user's touch is input to the second touch panel 222. To this end, the second touch C / B 225 may include a controller board and an OS board connected to the second touch panel 222 to drive the touch.

In the present invention, the touch signal obtained by the touch C / B of at least one of the first touch C / B 215 and the second touch C / B 225 is controlled by the first touch I / F 214 and the first control. Merged via the module 226, the merged first touch information may be shared with other display terminals 230 and 240.

The first control module 226 merges the coordinate data included in the touch signal recognized through the multi touch panels 212 and 222 to generate first touch information. Here, the generated first touch information may be shared with other display terminals 230 and 240.

The third display terminal 230 is a terminal equipped with a single touch panel and serving as a slave in the display system 100. The third display panel 231, the third touch panel 232, and the third image are provided. I / F 233, third touch I / F 234, third touch C / B 235, and the like. In the present invention, the display system 100 is composed of a terminal playing a role of one master and a plurality of terminals playing a role of a slave, it is also possible to have two or more terminals playing a master role.

The third display panel 231 has the same concept as the first display panel 211 in the third display terminal 230. The third touch panel 232 has the same concept as the first touch panel 212 in the third display terminal 230. The third image I / F 233 has the same concept as the first image I / F 213 in the third display terminal 230. The third touch I / F 234 has the same concept as the first touch I / F 214 in the third display terminal 230. The third touch C / B 235 has the same concept as the first touch C / B 215 in the third display terminal 230.

The fourth display terminal 240 is a terminal which plays a role of a slave in the display system 100 together with the third display terminal 230. The fourth display panel 241, the fourth touch panel 242, the fourth image I / F 243, the fourth touch I / F 244, and the fourth touch C included in the fourth display terminal 240. The third display panel 231, the third touch panel 232, the third image I / F 233, and the third touch I / F 234 which are included in the third display terminal 230, etc. ), The first display panel 211, the first touch panel 212, the first image I / F 213, and the first display panel 210 included in the first display terminal 210, such as the third touch C / B 235. The same concept as the one touch I / F 214, the first touch C / B 215, and the like.

In the display system 100 of the present invention, the plurality of display terminals, such as the third display terminal 230 and the fourth display terminal 240, perform one-way communication with the first display terminal 210 while having one touch panel. Although described as, but is not necessarily limited thereto. For example, when a display terminal having a predetermined size or more is present among the plurality of display terminals, the display terminal may be implemented in the form of a multi-touch panel.

The internal structure of the display system 100 using the multi-touch panel has been described above with reference to FIGS. 1 and 2. Hereinafter, a touch information processing operation of a terminal having a multi touch panel in the display system 100 will be described.

3 is a first reference diagram illustrating a touch information processing operation of a terminal having a multi-touch panel in a display system according to an embodiment of the present invention, and FIG. 4 is a multi-touch in a display system according to an embodiment of the present invention. It is a 2nd reference figure for demonstrating the touch information processing operation | movement of the terminal provided with a panel.

In the present embodiment, the operation of sharing touch information between the first display terminal 210 serving as the master and the third display terminal 230 serving as the slave will be described with reference to FIGS. 3 and 4. In addition, it is a matter of course that the touch information may be shared between the third display terminal 230 and the fourth display terminal 240 in the role of a slave.

First, a hardware structure will be described with reference to FIG. 3.

The first touch C / B 215 includes a first touch controller 311 and a first MCU 312.

The first touch controller 311 performs a function of driving the first touch panel 212 positioned on a portion of the first display panel 211 by a touch sensor under the control of the first MCU 312.

The first MCU 312 controls the first touch controller 311 to acquire touch information input to the first touch panel 212. When a touch is input on the first touch panel 212, the first MCU 312 performs a function of acquiring coordinate data of the touch as a first touch signal. The first MCU 312 may be implemented in the form of a field programmable gate array (FPGA) in the present invention.

The second touch C / B 225 includes a second touch controller 331 and a second MCU 332.

The second touch controller 331 performs a function of driving the second touch panel 222 positioned on a portion of the first display panel 211 with a touch sensor under the control of the second MCU 332.

The second MCU 332 controls the second touch controller 331 to acquire touch information input to the second touch panel 222. When a touch is input on the second touch panel 222, the second MCU 332 acquires coordinate data of the touch as a second touch signal. The second MCU 332 may be implemented in the form of a field programmable gate array (FPGA) in the present invention.

The first controller 320 merges the first touch signal acquired by the first MCU 312 and the second touch signal acquired by the second MCU 332 to generate first touch information, and generates the first touch information. The touch information is reflected to the image data output by the first display panel 211. In addition, the first control unit 320 transmits the first touch information generated by merging the first touch signal and the second touch signal to a third control unit (not shown) that interworks with the third display panel 231. The same may be applied to image data output by the display panel 231.

The first control unit 320 receives the third touch information through a third control unit (not shown) that interworks with the third display panel 231 and reflects the third touch information to the image data output by the first display panel 211. Also perform.

The first controller 320 is communicatively connected to a third controller (not shown) that interworks with the third display panel 231 through a wired or wireless communication network. Here, the wired / wireless communication network for sharing information between the first display panel 211 and the third display panel 231 includes an intranet, the Internet, the Bluetooth, the Wi-Fi, the Wi-Fi, and the like. There is this. The first control unit 320 and the third control unit (not shown) may be implemented in the form of a main controller such as a computer, a smartphone, and the like in the present invention.

In FIG. 3, the configuration of the third touch C / B 235 that interacts with the third display panel 231, that is, the third touch controller, the third MCU, and the like is configured as the first touch controller 311 and the first MCU 312. As it is implemented in the same concept as the first touch C / B 215 including a description of the overlapping concept will be omitted.

Next, the software structure will be described with reference to FIG.

The first touch driver 410 is a module performed by the first MCU 312, and includes a touch coordinate converting unit 411, a touch coordinate panel setting unit 412, a touch coordinate recognition unit 413, and a touch coordinate merging unit. 414.

The touch coordinate converter 411 performs a function of acquiring a touch signal shared by the other terminals 230 and 240 through the first touch I / F 214. Also, the touch coordinate converter 411 converts the coordinate data included in the obtained touch signal to suit the resolution of the first display panel 211. Here, the touch coordinate converter 411 is described as converting coordinate data based on the resolution information of the first display panel 211, but is not necessarily limited thereto. For example, the touch coordinate converter 411 may convert coordinate data included in the touch signal to match the resolution of the multi-touch panel. The touch coordinate converter 411 generates third touch information including the converted coordinate data, and transfers the generated third touch information to the touch coordinate panel setting unit 412.

The touch coordinate panel setting unit 412 obtains third touch information from the touch coordinate converting unit 411, and includes third touch information among the multi-touch panel, that is, the first touch panel 212 and the second touch panel 222. Select a touch panel corresponding to the third touch information;

The touch coordinate panel setting unit 412 compares coordinate data included in the third touch signal with resolution coordinates of each of the first touch panel 212 and the second touch panel 222 to match the third touch information. To pass.

The touch coordinate recognition unit 413 recognizes at least one touch signal input to at least one touch panel among the multi-touch panels. The touch coordinate recognition unit 413 recognizes a touch input from at least one touch panel of the first touch panel 212 and the second touch panel 222, and generates the recognized coordinate data as a touch signal.

The touch coordinate recognition unit 413 may obtain coordinate data from each of the first touch panel 212 and the second touch panel 222 to generate a first touch signal and a second touch signal. The touch coordinate recognition unit 413 transfers at least one touch signal including coordinate data to the touch coordinate merging unit 414 to be merged.

The touch coordinate merging unit 414 obtains at least one touch signal from the touch coordinate recognition unit 413 and merges the obtained touch signals to generate first touch information. The touch coordinate merging unit 414 preferably merges touch signals based on the resolution of the multi-touch panel, but is not limited thereto.

When the touch coordinate merging unit 414 acquires the first touch signal and the second touch signal from the touch coordinate recognition unit 413, the touch coordinate merging unit 414 merges the first touch signal and the second touch signal to correspond to the resolution of the multi-touch panel. To generate first touch information.

If the touch coordinate merging unit 414 obtains a touch signal with respect to the interface between the first touch panel 212 and the second touch panel 222, the touch coordinate merging unit 414 may be a first touch from the touch coordinate recognition unit 413. The signal may be divided into a second touch signal and separately received. In this case, the touch coordinate merging unit 414 may generate touch information including one coordinate operation but two coordinate data positioned on the boundary surface of the touch panel based on the first touch signal and the second touch signal.

In order to prevent such a case, the touch coordinate merging unit 414 may separately store and manage boundary coordinate data of the boundary surface of the multi-touch panel. The touch coordinate merging unit 414 determines that the first touch signal and the second touch signal acquired from the touch coordinate recognition unit 413 are closer to the preset reference value based on the boundary coordinate data to determine one coordinate data during the merging process. The first touch information may be generated.

Meanwhile, the touch coordinate merging unit 414 transmits the merged first touch information to the other terminals 230 and 240 through the first touch I / F 214.

When the display terminals 210, 230, and 240 are connected in communication with each other to share image information, the display terminals 210, 230, and 240 of the touch panels 212, 222, 232, and 242 of the display terminals 210, 230, and 240 are provided. Information about the resolution may also be shared. Here, in the case of the first display terminal 210 equipped with the multi-touch panel, information on the resolution of combining the first touch panel 212 and the second touch panel 222 may be shared.

For example, when touch information is received from the third display terminal 230, the touch coordinate converting unit 411 may include information about a resolution in which the first touch panel 212 and the second touch panel 222 are combined with the third touch. Based on the information on the resolution of the panel 232, the coordinate data received from the third display terminal 230 may be converted to suit the first display terminal 210.

Meanwhile, in the present invention, when the touch information is transmitted to another terminal, the touch information may be transmitted by including information about the resolution of the touch panel (or information about the resolution of the display panel).

The OS platform 420 and the application layer 430 are modules performed by the first controller 320. The OS platform 420 is related to the operating system of the first control unit 320, and the application layer 430 is related to the application program of the first control unit 320. The OS platform 420 and the application layer 430 may include the first touch information, the touch coordinate converter 411, and the touch coordinate panel of the own terminal obtained by the touch coordinate recognizer 413 and the touch coordinate merger 414. The third touch information of another terminal acquired by the setting unit 412 is reflected in the image data output by the first display panel 211.

The third touch driver 450 is a module performed by a third MCU (not shown) included in the third display terminal 230, and according to the present invention, the touch coordinate converter 411 of the first touch driver 410 is provided. And the same function as the touch coordinate recognition unit 413. Meanwhile, when the third display terminal 230 is a terminal having a multi-touch pad, the touch coordinate panel setting unit 412 and the touch coordinate merging unit 414 of the first touch driver 410 are further performed. can do.

The touch information processing operation of the terminal having the multi-touch panel proposed by the present invention has been described above with reference to FIGS. 3 and 4. In summary, the method proposed by the present invention is as follows.

(1) When touch information is obtained by the magnetic terminal equipped with the multi touch panel

The touch information obtained by merging one or more touch signals recognized from at least two touch panels is reflected in the image data output by the own terminal and transmitted to the other terminal through an interface.

(2) When touch information is obtained by another terminal

The touch information received from another terminal is converted into coordinate data suitable for the multi-touch panel of the own terminal to generate touch information, and after setting at least one touch panel matching the touch information among the multi-touch panels, the corresponding touch information is generated. It is reflected in the video data output by the own terminal.

Next, in the display system 100 according to an embodiment of the present invention, when the first display terminal 210 serving as a master and the third display terminal 230 serving as a slave acquire both touch information ( The bidirectional operation) and the case where only the first display terminal 210 acquires the touch information (unidirectional operation) will be described. Hereinafter, a bidirectional operation and a unidirectional operation will be described with respect to one display terminal serving as a master and one display terminal serving as a slave role. The same may be applied to a plurality of display terminals serving as display terminals and slaves.

In addition, as described above, the bidirectional operation and the unidirectional operation may be applied to the third display terminal 230 and the fourth display terminal 240 which serve as slaves.

FIG. 5 is a flowchart of a bidirectional operation in the display system according to an exemplary embodiment of the present invention, and FIG. 6 is a flowchart of a bidirectional operation in the display system according to an exemplary embodiment of the present invention.

First, the bidirectional operation will be described with reference to FIG. 5.

The first touch controller 311 of the first display terminal 210 senses a first touch signal input to the first touch panel 212 under the control of the first MCU 312 (S510). In addition, the second touch controller 331 of the first display terminal 210 senses a second touch signal input to the second touch panel 222 under the control of the first MCU 332 (S520). This function of the first MCU 312 may be performed by the touch coordinate recognition unit 413 of the first touch driver 410.

Thereafter, the first MCU 312 of the first display terminal 210 senses the coordinate data of the portion where the first touch signal is sensed on the first touch panel 212 and the second touch signal on the second touch panel 222. The merged coordinate data of the portion is generated, and first touch information including the merged coordinate data is generated (S530). This function of the first MCU 312 may be performed by the touch coordinate merging unit 414 of the first touch driver 410.

Thereafter, the first control unit 320 of the first display terminal 210 reflects the first touch information on the image data output through the first display panel 211 (S532).

Meanwhile, when the third touch controller (not shown) of the third display terminal 230 senses the third touch signal input to the third touch panel 232, the first touch I / of the first display terminal 210 is detected. F 214 obtains a third touch signal through a wired or wireless communication network (S540).

Thereafter, the first MCU 312 of the first display terminal 210 receives a third touch signal based on the information on the resolution of the third touch panel 232 and the resolution on the multi-touch panels 212 and 222. Coordinate data of the sensed portion is converted to be suitable for the multi-touch panels 212 and 222 to generate third touch information (S550).

For example, the resolution of the multi-touch panel including the first touch panel 212 and the second touch panel 222 is 2 * 2, the resolution of the third touch panel 232 is 4 * 4, and the third touch signal is sensed. If the coordinate data of the part is (2, 2), the first MCU 312 converts the coordinate data into (1, 1) so as to be suitable for the multi-touch panel and generates the third touch information. This function of the first MCU 312 may be performed by the touch coordinate converter 411 of the first touch driver 410.

The first MCU 312 of the first display terminal 210 selects a touch panel corresponding to the third touch information among the multi-touch panels, and transfers the third touch information to the selected touch panel (S552). For example, the first MCU 312 may compare the coordinate data included in the third touch signal with the resolution coordinates of each of the first touch panel 212 and the second touch panel 222 to match the third touch panel. Deliver touch information.

Thereafter, the first controller 320 of the first display terminal 210 reflects the third touch information to the image data output through the first display panel 211 (S560).

Meanwhile, the first MCU 312 of the first display terminal 210 may reflect the first touch information and the third touch information in the image data output through the first display panel 211 in chronological order. When generating the first touch information and the third touch information, it is also possible to include the time of sensing the first touch signal and the time of sensing the third touch signal, respectively.

Meanwhile, when the first touch signal is sensed by the first touch controller 311, the first MCU 312 of the first display terminal 210 transmits the first touch signal to the third touch signal through the first touch I / F 214. Of course, the transmission to the display terminal 230.

Next, the unidirectional operation will be described with reference to FIG. 6.

In the unidirectional operation, only the first display terminal 210 senses the touch signal, and the third display terminal 230 does not sense the touch signal. Thus, unlike the case of the bidirectional operation, the operation process of the first display terminal 210 using the touch information sensed by itself and the operation process of the first display terminal 230 using the touch information acquired from another terminal are different from each other.

Hereinafter, an operation process of the first display terminal 210 using self-sensed touch information will be described first with reference to FIG. 6A, and then touch information obtained from another terminal with reference to FIG. 6B. An operation process of the first display terminal 230 using FIG.

First, referring to FIG. 6A, the first touch controller 311 of the first display terminal 210 receives a first touch input to the first touch panel 212 under the control of the first MCU 312. The signal is sensed (S610). In addition, the second touch controller 331 of the first display terminal 210 senses a second touch signal input to the second touch panel 222 under the control of the first MCU 332 (S620). This function of the first MCU 312 may be performed by the touch coordinate recognition unit 413 of the first touch driver 410.

Thereafter, the first MCU 312 of the first display terminal 210 senses the coordinate data of the portion where the first touch signal is sensed on the first touch panel 212 and the second touch signal on the second touch panel 222. The merged coordinate data of the portion is generated, and first touch information including the merged coordinate data is generated (S630). This function of the first MCU 312 may be performed by the touch coordinate merging unit 414 of the first touch driver 410.

Thereafter, the first controller 320 of the first display terminal 210 reflects the first touch information on the image data output through the first display panel 211 (S632).

Next, referring to FIG. 6B, the first touch I / F 214 of the first display terminal 210 acquires a third touch signal from the third display terminal 230 through a wired / wireless communication network ( S610 ').

Thereafter, the first MCU 312 of the first display terminal 210 receives a third touch signal based on the information on the resolution of the third touch panel 232 and the resolution on the multi-touch panels 212 and 222. Coordinate data of the sensed portion is converted to be suitable for the multi-touch panels 212 and 222 to generate third touch information (S620 ').

For example, the resolution of the multi-touch panel including the first touch panel 212 and the second touch panel 222 is 2 * 2, the resolution of the third touch panel 232 is 4 * 4, and the third touch signal is sensed. If the coordinate data of the part is (2, 2), the first MCU 312 converts the coordinate data into (1, 1) so as to be suitable for the multi-touch panel and generates the third touch information. This function of the first MCU 312 may be performed by the touch coordinate converter 411 of the first touch driver 410.

The first MCU 312 of the first display terminal 210 selects a touch panel corresponding to the third touch information among the multi-touch panels, and transfers the third touch information to the selected touch panel (S630 ′). For example, the first MCU 312 may compare the coordinate data included in the third touch signal with the resolution coordinates of each of the first touch panel 212 and the second touch panel 222 to match the third touch panel. Deliver touch information.

Thereafter, the first controller 320 of the first display terminal 210 reflects the third touch information to the image data output through the first display panel 211 (S640 ′).

In FIGS. 5 and 6, the steps are sequentially executed, but are not necessarily limited thereto. In other words, since the steps described in FIGS. 5 and 6 may be applied by changing the steps or executing one or more steps in parallel, FIGS. 5 and 6 are not limited to the time series order.

Next, one display terminal (first display terminal 210 with a multi-touch panel) serving as a master role and a plurality of display terminals (third display terminal 230 and fourth display terminal) serving as slaves. A method of reflecting coordinate data generated by the touch information to the image data by reference numeral 240, the fifth display terminal 250,...

In the following embodiment, one display terminal (first display terminal 210 with a multi-touch panel) having a master role and three display terminals (third display terminal 230, third) having a slave role The method of reflecting the coordinate data to the image data will be described by the four display terminals 240 and the fifth display terminal 250, but the number of terminals acting as a master and the number of terminals acting as a slave are described. It is not limited.

7 is a reference diagram for describing a method of processing touch information in a non-real time in a display system according to an exemplary embodiment of the present invention, and FIG. 8 is a diagram illustrating processing of touch information in real time in a display system according to an exemplary embodiment of the present invention. It is a reference figure for demonstrating a method.

First, the touch information real time processing method will be described with reference to FIG. 7.

The first display terminal 210 merges the first touch signal (first touch coordinate) and the second touch signal (second touch coordinate) sensed from each of the first touch panel 212 and the second touch panel 222. To generate first touch information, and coordinates 0, 1, 2,... According to the first touch information. When coordinate data such as a coordinate n is obtained, the first image data 710 is generated by reflecting the image data output by the first display panel 211 as touch information.

Coordinate data obtained according to the first touch information generated based on the multi-touch panel is shared with the third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, and the like through the wired / wireless communication network. The third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, etc. may be the third display panel 231, the fourth display panel 241, the fifth display panel (not shown), or the like. The third image data 720, the fourth image data 730, the fifth image data 740, etc. are generated by reflecting the coordinate data according to the first touch information to the image data output by the controller.

Meanwhile, if the processing speeds of the third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250 do not reach the processing speed of the first display terminal 210, the touch information real time described with reference to FIG. 7 is performed. The processing method is difficult to implement.

In the present invention, the first touch information may be processed in non-real time in consideration of such an implementation difficulty. Hereinafter, a method of processing non-real-time touch information will be described with reference to FIG. 8.

The first display terminal 210 may share the coordinate data included in the first touch information according to the multi-touch panel with the third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250. Information about the processing speed is obtained.

Information on the processing speed of the third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250 may be displayed in the third display terminal 230, the fourth display terminal 240, and the fifth display. When the terminal 250 is connected to the first display terminal 210 in communication with the first display terminal 210, the third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250. ) May be provided to the first display terminal 210 when it is registered with the first display terminal 210.

When information on the processing speed of the third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250 is obtained, the first display terminal 210 may display its own processing speed and the third display. The third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250 by comparing the processing speeds of the terminal 230, the fourth display terminal 240, and the fifth display terminal 250. It is determined whether or not the processing speed is higher than its own processing speed.

If it is determined that the processing speed of the third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, or the like is higher than that of the first display terminal 210, the display system according to the present invention ( In operation 100, the first touch information is processed according to the method of FIG. 7.

In contrast, when it is determined that the processing speed of at least one of the third display terminal 230, the fourth display terminal 240, and the fifth display terminal 250 is less than the processing speed of the first display terminal 210, In the display system 100 according to the present invention, the first touch information is processed according to the method of FIG. 8.

Meanwhile, in the present invention, the third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, and the like are previously set to communicate with the first display terminal 210 through a registration process in advance. It is also possible.

For example, by utilizing a wired or wireless communication network such as WiFi, Bluetooth, TCP-IP, UDP, USB, etc., a bidirectional interface may be implemented to secure security by granting access rights with common pin numbers. have. In this case, once connected terminals do not need to register a separate pin number when reconnecting.

According to FIG. 8, the touch information non-real-time processing method is operated in the following order.

The first display terminal 210 merges the first touch signal (first touch coordinate) and the second touch signal (second touch coordinate) sensed from each of the first touch panel 212 and the second touch panel 222. To generate first touch information, and coordinates 0, 1, 2,... According to the first touch information. When coordinate data such as a coordinate n is obtained, the first image data 710 is generated by reflecting the image data output by the first display panel 211 as touch information.

In addition, when the coordinate data according to the first touch information is acquired, the first display terminal 210 coordinates with the third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, and the like in a predetermined order. Send data sequentially. For example, the coordinate data are obtained in the order of coordinate 0, coordinate 1, coordinate 2, and the like, and the order of receiving the coordinate data is the third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, or the like. In this case, the first display terminal 210 transmits coordinate 0 to the second display terminal 220, and then transmits coordinate 1 and coordinate 2 to the third display terminal 230 and the fourth display terminal 240, respectively. .

When the coordinate data are received from the first display terminal 210, the third display terminal 230, the fourth display terminal 240, the fifth display terminal 250, and the like are based on the third 'image data ( 720 '), fourth' image data 730 ', fifth' image data 740 ', and the like.

The present invention described above can be applied to a smart school copyboard, a business video conferencing system, a DID device using big data, and the like. The bidirectional touch application proposed in the present invention is not only a smart phone but also an AIO, PC, Note-PC, and TV. The present invention can be applied to any display device employing a touch panel.

As mentioned above, one Embodiment of this invention was described with reference to FIGS. Hereinafter, the preferable form of this invention which can be deduced from such one Embodiment is demonstrated.

9 is a conceptual diagram schematically illustrating an interactive touch screen device according to an exemplary embodiment of the present invention.

9, the multi-touch panel screen apparatus 900 capable of bidirectional communication according to an exemplary embodiment of the present invention includes a coordinate data acquisition unit 910, a coordinate panel determination unit 912, a coordinate data conversion unit 920, The coordinate data merging unit 922, the image data processing unit 930, a power supply unit 940, and a main control unit 950 are included.

The power supply unit 940 supplies power to each component of the multi-touch panel screen device 900.

The main controller 950 performs a function of controlling the overall operation of each component of the multi-touch panel screen device 900.

The coordinate data acquisition unit 910 recognizes at least one touch input to the multi-touch panel of the own terminal and performs a function of acquiring coordinate data of the recognized touch signal.

The coordinate data acquisition unit 910 recognizes the first touch signal and the second touch signal for each touch panel when the multi-touch panel includes the first touch panel 212 and the second touch panel 222. can do. Each touch signal may include a plurality of coordinate data for a plurality of touch operations. The coordinate data acquisition unit 910 transfers at least one touch signal including the coordinate data to the coordinate data merging unit 922 to be merged. The coordinate data acquisition unit 910 is a concept corresponding to the touch coordinate recognition unit 413.

The coordinate data merging unit 922 merges at least one touch signal to generate first touch information. The coordinate data merging unit 922 may merge the touch signal based on the resolution of the multi touch panel or the first display panel 211. The coordinate data merging unit 922 may generate first touch information by converting coordinate data included in each touch signal to match the resolution of the multi-touch panel, and then merging the coordinate data. The coordinate data merger 922 is a concept corresponding to the touch coordinate merger 414.

When the coordinate data converter 920 acquires a third touch signal input to a third touch panel of at least one other terminal, resolution information of the multi-touch panel and resolution information of the third touch panel provided in the other terminal. Perform a function of converting coordinate data of the third touch signal based on. The coordinate data converter 920 may also acquire resolution information of the third touch panel when acquiring coordinate data included in the third touch signal.

The coordinate data converter 920 converts coordinate data of the third touch signal to generate third touch information, and transfers the generated third touch information to the coordinate panel determiner 912. The coordinate data converter 920 is a concept corresponding to the touch coordinate converter 411.

The coordinate panel determiner 912 acquires third touch information and selects at least one touch panel corresponding to the third touch information from among the multi-touch panels. The coordinate panel determiner 912 compares the coordinate data included in the third touch signal with the resolution coordinates of each of the first touch panel 212 and the second touch panel 222 included in the multi-touch panel to match. Determine and transmit third touch information to the determined touch panel. The coordinate panel determiner 912 is a concept corresponding to the coordinate panel determiner 912.

The image data processor 930 is generated by the first touch information and coordinate data converter 920 and the coordinate panel determiner 912 generated by the coordinate data acquirer 910 and the coordinate data merger 922. The image data output from the own terminal is processed based on at least one coordinate data of the third touch information. The image data processor 930 is a concept corresponding to the first controller 320.

The multi-touch panel screen device 900 may further include a coordinate data transmission controller 961.

When the first touch information is generated by merging the first touch signal and the second touch signal sensed by the coordinate data acquisition unit 910, the coordinate data transmission control unit 961 may transmit the coordinate data of the first touch information to the terminal in real time. Performs the function of sending to. The coordinate data transmission control unit 961 is a concept corresponding to the first touch I / F 214 and the first MCU 312.

The multi-touch panel screen device 900 may further include a terminal state determiner 962.

The terminal state determination unit 962 performs a function of determining whether the terminal is a first terminal that senses a touch signal at a predetermined time or a second terminal that does not sense the touch signal.

If the terminal state determiner 962 determines that the terminal is the second terminal, the coordinate data acquirer 910 does not operate. On the other hand, if the terminal state determiner 962 determines that the own terminal is the first terminal, the coordinate data acquisition unit 910 operates normally.

The multi-touch panel screen device 900 may further include a processing speed determiner 963.

The processing speed determining unit 963 performs a function of determining whether data processing speeds of at least two other terminals are greater than or equal to data processing speeds of the own terminal.

In this case, the coordinate data transmission control unit 961 may operate as follows.

First, if it is determined that the data processing speeds of at least two other terminals are equal to or greater than the data processing speed of the own terminal, the coordinate data transmission control unit 961 simultaneously transmits coordinate data of the first touch information to at least two other terminals.

Second, if it is determined that the data processing rate of at least one of the at least two other terminals is less than the data processing rate of the own terminal, the coordinate data transmission control unit 961 is configured to at least whenever the coordinate data of the first touch information is obtained. Transmit sequentially to two other terminals.

The multi-touch panel screen device 900 may further include a reception order determiner 964.

The reception order determination unit 964 performs a function of determining a coordinate data reception order of at least two other terminals based on a distance between its own terminal and each other terminal.

In this case, the coordinate data transmission control unit 961 sequentially transmits to the at least two other terminals based on the coordinate data reception order.

The multi-touch panel screen device 900 may further include a connection authorization unit 965.

The access authorization unit 965 performs a function of communicating and connecting the terminal with the other terminal based on the information on the other terminal provided to the terminal when the terminal and the other terminal are initially connected.

In this case, the coordinate data converter 920 obtains coordinate data of the third touch information with respect to another terminal that is in communication with its terminal.

Next, an operation method of the multi-touch panel screen device 900 will be described.

First, the coordinate data acquisition unit 910 recognizes first touch information input to the first touch panel of the own terminal to obtain coordinate data of the first touch information (STEP A).

Thereafter, when the coordinate data converter 920 obtains coordinate data of the third touch information input to the third touch panel of the at least one other terminal, information about the resolution of the first touch panel and the resolution of the third touch panel The coordinate data of the third touch information is converted based on the information (STEP B).

Thereafter, the image data processor 930 processes the image data output from the terminal based on at least one of the coordinate data of the first touch information and the coordinate data of the third touch information (STEP C).

Meanwhile, between STEP A and STEP B, when the coordinate data transmission control unit 961 obtains the coordinate data of the first touch information, the coordinate data transmission control unit 961 may transmit the coordinate data of the first touch information to another terminal in real time (STEP D). This step performed by the coordinate data transmission control part 961 may be performed any time as long as it is performed after STEP A.

Meanwhile, before STEP A, the terminal state determiner 962 may determine whether the terminal is the first terminal that senses the touch signal at a predetermined time or the second terminal that does not sense the touch signal. In this case, the coordinate data acquisition unit 910 does not operate when the terminal state determination unit 962 determines that the terminal is the second terminal.

Meanwhile, between STEP A and STEP D, the processing speed determining unit 963 may determine whether the data processing speeds of at least two other terminals are greater than or equal to the data processing speed of the own terminal (STEP E). In this case, if it is determined that the data processing speeds of at least two other terminals are equal to or higher than the data processing speed of the own terminal, the coordinate data transmission control unit 961 simultaneously transmits coordinate data of the first touch information to at least two other terminals. On the other hand, if it is determined that the data processing speed of at least one of the at least two other terminals is less than the data processing speed of the own terminal, the coordinate data transmission control unit 961 may determine whether at least two coordinate data of the first touch information are acquired. It sequentially transmits to the other terminals.

Meanwhile, between STEP E and STEP D, the reception order determiner 964 may determine the order of receiving coordinate data of at least two other terminals based on the distance between the own terminal and each other terminal. In this case, the coordinate data transmission controller 961 may sequentially transmit to at least two other terminals based on the coordinate data reception order.

On the other hand, between STEP A and STEP B, the access authorization unit 965 may communicate connection between the terminal and the other terminal based on the information on the other terminal provided to the terminal when the terminal and the other terminal is the first communication connection. . In this case, the coordinate data converter 920 obtains coordinate data of the third touch information with respect to another terminal that is in communication with its terminal. The above steps of the access authorization unit 965 may be performed at any time if performed before STEP B.

Although all components constituting the embodiments of the present invention described above are described as being combined or operating in combination, the present invention is not necessarily limited to these embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all the components may be implemented as one independent hardware, each or some of the components are selectively combined to perform some or all functions combined in one or a plurality of hardware. It may be implemented as a computer program having a. In addition, such a computer program may be stored in a computer readable medium such as a USB memory, a CD disk, a flash memory, and the like, read and executed by a computer, thereby implementing an embodiment of the present invention. The recording medium of the computer program may include a magnetic recording medium, an optical recording medium and the like.

In addition, all terms including technical or scientific terms have the same meaning as commonly understood by a person of ordinary skill in the art unless otherwise defined in the detailed description. Terms used generally, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be interpreted in an ideal or excessively formal sense unless explicitly defined in the present invention.

The above description is merely illustrative of the technical spirit of the embodiments of the present invention, and those skilled in the art to which the embodiments of the present invention pertain various modifications without departing from the essential characteristics of the embodiments of the present invention. Modifications may be possible. Therefore, the embodiments of the present invention are not intended to limit the technical spirit of the embodiments of the present invention, but to describe, and the scope of the technical spirit of the embodiments of the present invention is not limited by these embodiments. The protection scope of the embodiments of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the embodiments of the present invention.

Claims (12)

A coordinate data acquisition unit for acquiring coordinate data by recognizing at least one touch signal input to at least one touch panel among multi-touch panels of the own terminal;
A coordinate data merging unit which merges the at least one touch signal to generate first touch information;
A coordinate data conversion unit for acquiring a third touch signal from a touch panel provided in at least one other terminal and converting coordinate data of the third touch signal to be applicable to the multi-touch panel to generate third touch information;
A coordinate panel determiner configured to determine at least one touch panel corresponding to the third touch information among the multi-touch panels; And
An image data processor configured to process image data output from the own terminal based on at least one coordinate data of the first touch information and the third touch information
Multi-touch panel-based bidirectional touch screen device comprising a. The method of claim 1,
The multi-touch panel includes a first touch panel and a second touch panel,
The coordinate data acquisition unit may recognize a first touch signal and a second touch signal from each of the first touch panel and the second touch panel, and obtain coordinate data for each touch signal. Based interactive touchscreen device. The method of claim 2,
The coordinate data merging unit,
And generating the first touch information by merging the first touch signal and the second touch signal based on the resolution information of the multi touch panel. The method of claim 2,
The coordinate data merging unit,
When the first touch signal and the second touch signal exist on the interface of the multi-touch panel, the first touch signal and the second touch signal are considered to be touch signals for one touch operation. A multi-touch panel-based bidirectional touch screen device which generates touch information. The method of claim 1,
The coordinate data converter,
The multi-touch panel-based bidirectionally characterized by generating coordinate information of the third touch signal based on the resolution information of the multi-touch panel and the resolution information of the touch panel provided in the other terminal. Touch screen device. The method of claim 5,
The coordinate panel determiner,
The at least one touch panel matching the third touch information is determined by comparing the coordinate data included in the third touch information with resolution coordinates of each of the multi touch panels. Screen device. In the multi-touch panel-based interactive touch screen device to process the touch information,
A coordinate data obtaining step of obtaining coordinate data by recognizing at least one touch signal input to at least one touch panel of the multi-touch panel of the own terminal;
A coordinate data merging step of merging the at least one touch signal to generate first touch information;
A coordinate data conversion step of acquiring a third touch signal from a touch panel provided in at least one other terminal, and generating third touch information by converting coordinate data of the third touch signal to be applicable to the multi-touch panel;
A coordinate panel determining step of determining at least one touch panel corresponding to the third touch information among the multi-touch panels; And
An image data processing step of processing image data output from the own terminal based on at least one coordinate data of the first touch information and the third touch information
Multi-touch panel based touch information processing method comprising a. The method of claim 1,
The multi-touch panel includes a first touch panel and a second touch panel,
The acquiring coordinate data may include: recognizing a first touch signal and a second touch signal from each of the first touch panel and the second touch panel, and obtaining coordinate data for each touch signal. Panel based touch information processing method. The method of claim 8,
The coordinate data merging step,
And generating the first touch information by merging the first touch signal and the second touch signal based on the resolution information of the multi touch panel. The method of claim 8,
The coordinate data merging step,
When the first touch signal and the second touch signal exist on the interface of the multi-touch panel, the first touch information is generated by determining coordinate data for a single touch operation. Touch information processing method. The method of claim 7, wherein
The coordinate data conversion step,
Multi-touch panel-based touch, characterized in that for generating the third touch information by converting the coordinate data of the third touch signal based on the resolution information of the multi-touch panel and the resolution information of the touch panel provided in the other terminal. Information processing method. The method of claim 11,
The coordinate panel determination step,
The touch information based on the multi-touch panel may be determined by comparing the coordinate data included in the third touch information with resolution coordinates of each of the multi-touch panels to determine the at least one touch panel matching the third touch information. Treatment method.

Images