WO2014021499A1

WO2014021499A1 - Apparatus and method for multi-touch recognition capable of discriminating touch on object

Info

Publication number: WO2014021499A1
Application number: PCT/KR2012/007454
Authority: WO
Inventors: 김숙영
Original assignee: (주)라온제나
Priority date: 2012-07-30
Filing date: 2012-09-18
Publication date: 2014-02-06
Also published as: KR20140016655A

Abstract

The present invention relates to an apparatus and a method for a multi-touch recognition capable of discriminating a touch on an object. More particularly, the present invention relates to an apparatus and a method for a multi-touch recognition capable of discriminating a touch on an object, the apparatus and the method being capable of discriminating a reaction object which performs a reaction operation in reaction to a touch and a non-reaction object which does not react to a touch, thus recognizing only the touch for the reaction object and carrying out the reaction operation to the touch operation. According to the present invention, only the touch on the reaction object is recognized and the touch on the non-reaction object is ignored, thereby reducing waste of resources involved in the interpretation of a touch point.

Description

Apparatus and method for multi-touch recognition for identifying touch on an object

The present invention relates to a multi-touch recognition apparatus and method for identifying a touch on an object. More particularly, the present invention relates to a multi-touch recognition device and a method for identifying a touch on an object. The present invention relates to a multi-touch recognition apparatus and method for identifying a touch on an object capable of recognizing only a touch on an object and implementing a reaction action according to the touch action.

When using multi-touch content, multi-touch control programs pay attention only to the correct touch on the screen and the number of touch points, thereby reducing the usability of the multi-touch. For example, if there is a background area that does not respond to touch at all, even if the user touches the background, the multi-touch control programs recognize a touch on the background.

Since touch points are not infinitely recognizable, recognizing a touch on an area that does not respond to touch at all has negative consequences in terms of hardware or software resources.

For example, suppose that four fingers are in contact with a background of a screen that does not respond to touch at all in a multi-touch technology capable of recognizing six touch points. In such a case, since the multi-touch control program already recognizes the four touch points and occupies the resources thereof, only the two touch points can be recognized additionally and a larger number of touch points cannot be recognized. If all six touch points are used as two touch points that do not respond to the touch and two touch points that do not respond to the touch, no extra points remain and no further touches can be recognized, which significantly improves the performance of the multi-touch. Drop it.

When all six touch points are occupied, if no extra points remain and no further contact can be recognized, this significantly degrades the performance of the multi-touch.

Therefore, in order to improve the performance of multi-touch, there is a need for a multi-touch recognition technology capable of ignoring a touch on an area that does not respond to a touch and recognizing only a touch on a reaction object.

The problem to be solved by the present invention is to reduce the waste of resources involved in the interpretation of the touch point by ignoring the touch on the area that does not respond to the touch and only recognize the touch on the reaction object, and to identify the touch on the reaction object A multi-touch recognition apparatus and method are provided.

According to the present invention, it is possible to reduce the waste of resources involved in the interpretation of the touch point by recognizing only the touch on the response object and ignoring the touch on the non-response object.

In addition, according to the present invention, when applied to a touch recognition device having a predetermined number of touch points that can be recognized simultaneously, the touch points of the recognition device can be effectively used by ignoring the touch on the non-responsive object.

1 is a diagram illustrating multi-touch recognition according to the prior art and multi-touch recognition according to the present invention, respectively.

2 is a block diagram illustrating a multi-touch recognition device for identifying a touch on an object according to the present invention.

Figure 3 is a block diagram showing in detail the touch analysis unit.

4 is a flowchart illustrating a multi-touch recognition method for identifying a touch on an object according to the present invention.

In order to solve the above problems, a multi-touch recognition apparatus for identifying a touch on an object according to the present invention includes an object including a reaction object performing a reaction operation when the touch is performed and a non-responsive object not performing the reaction operation when the touch is performed. A content player for playing the contained content; A touch screen which outputs the content on the screen in association with a content player and detects at least one touch point on the screen; A position obtaining unit obtaining a position of the touch point; And a touch analysis unit configured to monitor a change in the touch point when the position of the touch point exists in the reactive object area, and ignore touch recognition of the touch point when the position of the touch point exists in the non-response object area. .

Preferably, the touch point may be a starting point of the touch.

Preferably, the touch analysis unit may include an operation analysis unit for determining a reaction operation of the reaction object according to the change of the monitored touch point.

Preferably, the touch interpreter may include an object manager that manages generation, destruction and reaction of an object.

Preferably, the object manager may manage the creation, destruction and reaction of the object.

Preferably, the object manager may recognize and manage at least one of a position, a boundary, and a size of each object output on the touch screen.

Preferably, the object manager may recognize and manage at least one of whether a plurality of objects overlap each other, an overlapping area, and an overlapping order.

Preferably, the object manager may register and manage each image corresponding to a menu, a button, a banner, and an icon by uploading or linking them as an object.

Preferably, the object manager may delete each image corresponding to a menu, a button, a banner, and an icon to destroy the object.

Preferably, the multi-touch recognizing apparatus may further include an object database storing object characteristic information including information on at least one of an object type, a shape, and a reaction operation according to a touch operation.

Preferably, the multi-touch recognition device may be mounted on at least one of a computer terminal, a personal portable terminal, a digital electronic table, and a distance information terminal.

In addition, to solve the above problems, a multi-touch recognition method for identifying a touch on an object according to the present invention includes the steps of: (a) the content player outputs the content on the screen; (b) the touch screen obtaining a position of the touch point; (c) determining whether a location of a touch point exists in a reaction object area that performs a reaction operation upon touch; (d) ignoring recognition of the touch point and change of the touch point when the location of the touch point exists in the non-response object area that does not perform a reaction operation upon touch; And (e) monitoring a change to the touch point when the position of the touch point exists in the reaction object area.

Preferably, the multi-touch recognition method may further include (g) implementing an operation of the reaction object according to the determined reaction operation.

On the other hand, in order to achieve the above object, the present invention provides a computer-readable recording medium recording a program for realizing the multi-touch recognition method.

As the inventive concept allows for various changes and numerous modifications, particular embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to the specific disclosed form, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "having" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described in the specification, and that one or more other features It should be understood that it does not exclude in advance the possibility of the presence or addition of numbers, steps, actions, components, parts or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art.

Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in the drawings denote like elements.

1 is a diagram illustrating multi-touch recognition according to the prior art and multi-touch recognition according to the present invention, respectively. 1 (a) illustrates multi-touch recognition according to the prior art, and FIG. 1 (b) illustrates multi-touch recognition according to the present invention.

The multi-touch recognition device and recognition method for identifying a touch on an object according to the present invention detects only a touch and a touch change on a reaction object that performs a reaction when touched, and implements a touch action according to the touch action. The present invention provides a recognition apparatus and method. In the present invention, when a touch is detected on a non-responsive object that does not perform a reaction upon touch, a resource related to touch gesture recognition may be reduced by ignoring touch and treatment changes on the non-responsive object.

In FIGS. 1A and 1B, the background region does not perform any response to touch.

The multi-touch recognition apparatus according to the related art detects and continuously monitors a touch on a background area and its touch change, even though no operation is performed on the touch on the background area.

Assume that there are six touch points that can be recognized simultaneously in the multi-touch recognition device according to the prior art. In this case, when six touch points P1 to P6 are recognized in the background, even if an object responding to a touch is touched (P7 to P9), the multi-touch recognition apparatus according to the prior art touch points P7 to P9 for the object. Cannot be detected, and the response operation according to the touch operation cannot be performed.

However, in the multi-touch recognition apparatus according to the present invention, even though six touch points P11 to P16 are detected in the background, since the background area is a non-responsive object, the touch recognition for the six touch points P11 to P12 for the background area is performed. And do not monitor the change in touch point.

Since the multi-touch recognition apparatus according to the present invention recognizes only the touch points P17 to P22 for the reaction object and monitors the change of the touch point, even if there are six touch points in the background area, only the touch point for the reaction object is present. Recognize only (P17 ~ P22) and monitor the change of the touch point.

Referring to FIG. 2, the multi-touch recognition apparatus 100 for identifying a touch on an object and a background according to the present invention includes a content player 110, a touch screen 120, a position acquisition unit 130, and a touch analysis unit ( 140, and may further include an object manager 150 and / or an object database 160.

The content player 110 plays the contents 10_1 to 10_n including various objects. The object includes a reaction object that performs a reaction upon touch and a non-response object that does not perform a response upon touch.

The touch screen 120 is interlocked with the content player 110 to output the content being played by the content player 110 on the screen, and simultaneously detects at least one touch point contacted on the screen.

The content 10_1 to 10_n played by the content player 110 includes an object, and the object includes a reaction object that performs a reaction when the body part is touched and a non-response object that does not perform the reaction when touched. do.

The reaction object is an object that performs a reaction operation according to the touch when the touch is performed. For example, if a window is an object, the size of the window window can be reduced or enlarged, the window window moved, the window window deleted, the upper part of the window window, the boundary of the window window, various function buttons included in the window window, or a specific area within the window window area. It may be implemented through a touch operation or a multi-touch on a location.

Also, when the video player is an object, various functions such as zooming out or zooming in the video play screen, moving the video play screen, playing, stopping, moving back and forth, adjusting the playback speed, adjusting the volume, adjusting the screen size, and selecting a video file can be performed. It may be implemented as a touch or gesture on a function button, a touch action or gesture in a player screen area, or a gesture using multi-touch and multi-touch.

In addition, the background region, which is a space between the objects, may perform a reaction operation when touched. Recently, a variety of application icons are arranged on a plurality of pages of a smart phone or tablet computer. When a user touches a background area between application icons and drags left and right, an operation of moving to another page may be implemented. In this case, since the reaction operation is performed according to the touch operation, the background region may also be included in the reaction object performing the reaction operation according to the touch.

Meanwhile, there may be a background area that does not perform any reaction operation according to the touch operation or the multi-touch operation. Thus, the background area that does not perform any reaction operation on the touch operation is a non-responsive object.

As a result, all objects that perform a specific reaction according to the touch action are reaction objects, and objects that do not perform the specific reaction action according to the touch action are non-response objects.

Here, the touch operation is a concept including at least one touch of a single single touch, multi touch, and touch gesture. For example, these touch gestures can be sized by touching and releasing a touch, tapping twice as quickly as a double-clicking of a mouse button, dragging without touching and releasing, or shortening or stretching the distance without touching and releasing two points. There may be a variety of touch operations, such as changing the (which is also used to zoom in and out of text or images), touching several points at the same time, and performing a specific gesture. The touch operation in the present invention is not limited to any of the specific touches described above, and all touch methods developed in the future as well as existing touch methods such as a single touch using a single finger, a multi touch using multiple fingers at the same time, and a gesture operation accordingly. It includes.

When a part of the body comes into contact with the touch screen 120, the position acquisition unit 130 obtains information on the location of the touch point, which is the point where the body part is in contact, and continues the information on the change of the touch point in real time. Monitor.

After touching the touch screen 120 using a body part such as a finger, various touch operations such as removing, dragging, or double touching may be performed. In order to distinguish the touch operation, it is necessary to determine the position of the initial touch, that is, the starting point of the touch, and monitor the change of the touch point.

To this end, the position acquisition unit 130 identifies the starting point of the touch and continuously monitors the change of the touch point. Information about the starting point of the touch and the trajectory change of the touch point is provided to the touch interpreter 140.

The touch interpreter 140 continuously monitors the change of the touch point when the position of the touch point is in the reaction object area output on the screen, and touches the touch point when the position of the touch point is in the non-response object area. Ignore recognition.

In addition, the touch interpreter 140 analyzes a touch action on the reaction object, determines a reaction action corresponding to the touch action, and controls the content player to implement the reaction action of the reaction object.

3 is a block diagram showing in detail the touch analysis unit.

Referring to FIG. 3, the touch interpreter 140 includes an object manager 141, a position comparator 142, and an operation interpreter 143.

The object manager 141 manages the generation, destruction, and action of all objects played through the content player 110 with reference to the object database 160.

The object database 150 stores characteristic information about all objects including the reaction object and the non-reaction object. The characteristic information is information including at least one of a type, a shape, a size of an object, and a reaction operation according to a touch operation. The characteristic information may further include information about a color, an area, and a pixel position when outputting the object.

The object manager 141 refers to the object database 150 to grasp characteristics of each object, and manages generation, destruction, and action of all objects played through the content player 110.

Each object may have a different size, angle, shape, color, area, pixel position, and the like when outputted on the screen. The object manager 141 recognizes and manages at least one of the size, angle, shape, color, area, pixel position, and boundary of each object when each object is generated and displayed on the screen. It also manages the reaction action according to the action.

In addition, when a plurality of objects are output, the object manager 141 may also manage overlapping orders and overlapping areas when overlapping occurs between the plurality of objects. That is, the object manager 141 may recognize and manage at least one of whether the plurality of objects overlap each other, an overlapping area, and an overlapping order.

In addition, the object manager 141 also uploads or links each image corresponding to various icons including at least one of a menu, a button, and a banner to register and manage the object in the object database 150 as an object. do.

In addition, the object manager 141 may delete each image corresponding to various icons including at least one of a menu, a button, and a banner, and then delete the images from the object.

The position comparison unit 142 determines whether the touch point is located in the object area by comparing the position of each object output in the screen with the position of the touch point on the screen.

When the touch point is located in the object area, the operation interpreter 143 determines whether the type of the object is a reactive object or a non-responsive object.

If the type of object is a non-responsive object, the operation analysis unit 142 ignores the touch on the non-responsive object. That is, when the touch on the non-responsive object is detected, the operation interpreter 142 does not monitor the change in the touch point for the non-responsive object.

On the other hand, if the type of the object is a reaction object, the operation analysis unit 142 interprets the touch operation based on the information on the change of the touch point for the reaction object, and the object to perform the reaction operation according to the interpreted touch operation To control.

As mentioned above, you can change the size by touching and releasing the touch, tapping twice quickly as if you double-clicked the mouse button, dragging without touching and releasing, and shortening or stretching the distance without touching and releasing the two points ( It can be used to enlarge or reduce text), touch various points at the same time, and perform various gestures.

The motion analysis unit 143 determines the response motion of the object based on the information on the change of the monitored touch point, that is, the analysis result of the touch motion, and provides the content player 110 with information on the determined reaction motion.

As described above, the object characteristic information such as the type, shape, and response of the touch operation is stored in the object database 160. The operation interpreter 142 analyzes the reaction operation of the object according to the touch operation with reference to the object database 160, and provides the analysis result to the content player 110.

The content player 110 causes the object to perform a reaction operation according to the touch operation according to the result of the operation analysis unit 143.

On the other hand, an object can have various function buttons in its area, each of which is treated as an independent object.

For example, assume that a video player for outputting a video on a touch screen is outputting a video.

The video player outputs video on the touch screen, and the video player has a stop button, a play button, a pause button, a forward and backward button, and a volume control button.

In this case, the size of the video window being played by the video player may be adjusted by touching and dragging the border of the video window, and the stopping, playing, and volume control of the video may be controlled by touching respective buttons. In addition, the video window may be moved to any area of the screen of the touch screen 110 by touching and dragging an area within the video window.

At this time, the video window and each button operate as independent objects.

Hereinafter, a multi-touch recognition method for identifying a touch on an object according to the present invention will be described. The multi-touch recognition method for identifying a touch on an object according to the present invention is a method performed by the multi-touch recognition apparatus for identifying a touch on an object according to the present invention. Omit it.

The touch screen 120 is interlocked with the content player 110 to output the content being played by the content player 110 on the screen (S10).

The touch screen 120 detects whether a body part, for example, a finger, is touched on the screen. That is, the touch screen 120 detects at least one touch point on the screen (S20).

If the touch point is detected, the position acquisition unit 130 obtains the position of the detected touch point (S30). Of course, the position acquisition unit 130 also keeps track of the change in the touch point in real time.

The touch interpreter 140 determines whether the location of the touch point exists in the reaction object area performing the reaction operation when the touch is performed (S40).

The step S40 will be described in more detail.

The touch interpreter 140 determines whether the position of the touch point exists in the object area. Then, the touch interpreter 140 determines the type of the touched object when the position of the touch point exists in the object area. To judge. Since the reaction operation according to the touch operation on the reaction object and the non-reaction object is different, the Tay analysis unit 140 accurately determines whether the touched object is a reaction object or a non-reaction object.

If the location of the touch point exists in the non-response object area that does not perform a reaction operation when the touch is performed, the touch interpreter 140 ignores the recognition of the touch point and does not monitor the change of the touch point (S50). .

On the other hand, if the location of the touch point is present in the reaction object area, the touch analysis unit 140 monitors the change of the touch point to interpret the touch operation (S60).

The touch interpreter 140 determines a reaction operation according to the touch operation with reference to the object database 150 (S70). The response action according to the determined touch action is provided to the content player.

The content player 110 implements the operation of the response object according to the analysis result of the touch interpreter. That is, the content player 110 operates the reaction object according to the determined reaction operation (S80).

The method of the present invention can also be embodied as computer readable code on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet). Include. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

The multi-touch recognition apparatus and method for identifying a touch on an object according to the present invention may be mounted on various devices and implemented. In addition to being included in a general computer terminal, it can be mounted in personal portable terminals such as smartphones and tablet computers. In addition, it can be implemented in a variety of devices, such as a distance information terminal that is installed in a digital electronic table and a street that can be used by multiple people at the same time to provide a variety of information through a touch input of a plurality of users.

According to the present invention, by only recognizing the touch on the response object and ignoring the touch on the non-response object, it is possible to reduce resource waste involved in the interpretation of the touch point.

In the above described the present invention with reference to the specific embodiment shown in the drawings, but this is only an example, those of ordinary skill in the art to which the present invention pertains various modifications and variations therefrom. Therefore, the protection scope of the present invention should be interpreted by the claims to be described later, and all the technical ideas within the equivalent and equivalent ranges should be construed as being included in the protection scope of the present invention.

Claims

A content player for playing content containing an object including a reaction object performing a reaction upon touch and a non-responsive object not performing the reaction upon touch;

A touch screen which outputs the content on the screen in association with the content player and detects at least one touch point on the screen;

A position obtaining unit obtaining a position of the touch point; And

A touch interpreter configured to monitor a change in the touch point when the location of the touch point exists in the reactive object area, and to ignore touch recognition of the touch point when the location of the touch point exists in the non-reactive object area; A multi-touch recognition device for identifying a touch on the object.
The apparatus of claim 1, wherein the touch point is a starting point of a touch.
The method of claim 1, wherein the touch analysis unit,

And an operation analysis unit for determining a reaction operation of the reaction object according to the change of the monitored touch point.
The method of claim 1, wherein the touch analysis unit,

And an object manager for managing generation, destruction, and reaction operations of the object.
The method of claim 4, wherein the object management unit,

Recognizing and managing at least one of its position, boundary, and size for each object output on the touch screen, the multi-touch recognition device for identifying a touch on the object.
The method of claim 4, wherein the object management unit,

And recognizing and managing at least one of overlapping, overlapping regions, and overlapping order of the plurality of objects.
The method of claim 4, wherein the object management unit,

And uploading or linking each image corresponding to a menu, a button, a banner, and an icon to register and manage the image as an object.
The method of claim 4, wherein the object management unit,

And deleting each image corresponding to a menu, a button, a banner, and an icon and erasing the image from the object.
The apparatus of claim 1, wherein the multi-touch recognition device comprises:

Multi-touch recognition for identifying a touch on an object, characterized by further comprising an object database storing object characteristic information including information on at least one of an object type, a form, and a reaction operation according to the touch operation. Device.
10. The apparatus of claim 1, wherein the multi-touch recognition device is

And at least one of a computer terminal, a personal digital assistant, a digital electronic table, and a distance information terminal.
A multi-touch recognition method performed by a multi-touch recognition device,

(a) the content player outputting the content to the screen;

(b) the touch screen obtaining a position of the touch point;

(c) determining whether the location of the touch point exists in a reaction object area that performs a reaction operation upon touch;

(d) ignoring recognition of the touch point and change of the touch point when the location of the touch point exists in the non-response object area that does not perform a reaction operation upon touch; And

and (e) monitoring a change to the touch point when the position of the touch point is present in the reactive object area.
The method of claim 11, wherein the method is

and determining a reaction operation of the reaction object according to the change of the monitored touch point.
The method of claim 11, wherein the method is

and (g) realizing an operation of the reaction object according to the determined reaction operation.
The method of claim 11,

And the touch point is a starting point of a touch.
A recording medium capable of working with a computer implementing a program for realizing the method according to any one of claims 11 to 14.