KR20140068585A - Method and apparatus for distinction of finger touch and pen touch on touch screen - Google Patents

Abstract

The present invention relates to a method for discriminating a finger touch and a pen touch on a touchscreen. The method comprises the steps of determining whether an electronic pen is recognized from a video obtained by at least one camera upon an input of a touch; operating, in an off state, any of a first touch panel sensing an input of the electronic pen and a second touch panel sensing an input of a finger touch, according to the determination results; and performing an operation corresponding to the touch input on the other panel which is not in the off state.

Description

Technical Field [0001] The present invention relates to a method and an apparatus for distinguishing a hand touch and a pen touch from a touch screen,

The present invention relates to a touch input device, and more particularly, to a method and apparatus for distinguishing a hand touch and a pen touch from a touch screen.

In recent years, a touch panel is mounted on a display device, and in addition to a screen display function, use of a touch screen that a user directly touches and inputs a screen is becoming common. In addition, various terminals such as a smart phone, a notebook PC, a tablet PC, a PDA (personal digital assistant), and a navigation device having a touch screen can be easily accessed.

The touch screen input method may be called a digitizer or an electric graphic input panel (EGIP). Depending on a method of detecting a position indicated by a user, a resistive method, a capacitive method, an electromagnetic resonance (EMR) method, Electro Magnetic Resonance) method (or electromagnetic method).

The resistance film type is a method of sensing a position depressed by a pressure by a change of an amount of current in a state in which a direct current voltage is applied and sensing that a thin conductive layer of two layers is contacted by a pressure of a finger or an electronic pen on a screen .

The capacitive method is a method of detecting capacitance by using a capacitance coupling in the state of applying an AC voltage. The object to be sensed must be a conductor and a contact area of more than a certain level is required to change the sensible capacitance .

The electromagnetic resonance method uses a digitizer sensor substrate composed of an array of loop coils. Accordingly, when the user moves the electronic pen, the electronic pen is driven by an AC signal so as to cause a resonating magnetic field, and the resonating magnetic field induces a signal to the coil of the digitizer sensor substrate, Position.

In this electromagnetic resonance method, a plurality of coils are mounted on a substrate, and the position of the electronic pen is detected by detecting the electromagnetic change caused by the approach of the electronic pen. Therefore, unlike the resistance film type, It can be mounted on the back of the display module. Accordingly, a multi-input device is provided that enables both a touch (digitizer) input device of an electromagnetic resonance type and a capacitive touch input device capable of sensing finger contact of a user.

However, in the case of a multiple input device capable of simultaneously inputting a touch input of an electromagnetic resonance type and a touch input of a capacitance type, a part of a hand is brought into contact with the touch screen on touch input of the electronic pen, An input error that is not related to the intention of the user may occur. In order to solve such a problem, Japanese Patent Application Laid-Open No. 2007-0079595 (entitled " Method and Apparatus for Correcting Input Errors in an Input Device ", inventor: Kwan-Hyung Kim, July 13, 2012), which is incorporated herein by reference in its entirety.

The Korean Patent Laid-Open Publication No. 2007-0079595 discloses an input device capable of performing a capacitive touch input and an electromagnetic resonance touch input. The capacitive touch input is performed during a capacitive touch input (before the capacitive touch input is released) Discloses a technique for canceling an operation performed by a capacitive touch input when an electromagnetic resonance type touch input is generated. That is, when the input of the electronic pen is started in the state where the hand touch input is not released, the above-described related art decides that the operations generated by the hand touch input are unintended operations and cancel the execution of the unintended operation .

However, in the related art, when the touch input of the electronic pen is temporarily released in the middle of the touch input of the electronic pen and the hand touch input is made, the operation performed by the hand touch input can be canceled, There is still an error in distinguishing the pen's touch input.

SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an electronic pen and a hand-touch multi-input device capable of preventing a hand touch input error from occurring when a touch input using an electronic pen is performed, And a pen touch method.

According to one aspect of the present invention, there is provided a method of distinguishing a hand touch and a pen touch from a touch screen, the method comprising: capturing an image with at least one camera at the time of touch input; Determining whether or not it is recognized; Operating a first touch panel for sensing input of an electronic pen and a second touch panel for sensing a touch input according to a result of the determination; And performing the touch input operation on a panel other than the panel operated in the off state.

According to another aspect of the present invention, there is provided an apparatus for distinguishing between a hand touch and a pen touch in a touch screen, comprising: a camera module including at least one camera for capturing a still image or a moving image; A touch screen including a first touch panel for sensing the input of the electronic pen and a second touch panel for sensing the input of the hand touch; The method of claim 1, further comprising: photographing an image with the at least one camera of the camera module when a touch is input on the touch screen; determining whether the electronic pen is recognized in the captured image; The touch panel and the second touch panel are operated in the OFF state and the operation of performing the operation of the touch input in the panel other than the panel operated in the OFF state is controlled do.

As described above, by using the method and apparatus for distinguishing between the hand touch and the pen touch in the touch screen according to the present invention, when the touch input using the electronic pen in the electronic pen and the hand touch multi- So that it is possible to solve the error of the inputted hand touch input irrespective of the intention of the user.

1 is a block diagram of a mobile device to which a device for distinguishing a hand touch and a pen touch is applied in a touch screen according to an embodiment of the present invention
FIG. 2 is a detailed block diagram of a touch screen controller and a touch screen in FIG.
FIG. 3 is a flowchart of a discriminating operation of the hand touch and the pen touch in the touch screen according to the embodiment of the present invention.
Fig. 4 is an exemplary diagram showing the occurrence of an unintended hand-touch error at the time of touch input of the electronic pen
5 is an exemplary diagram illustrating an operation of capturing an image with a camera when a touch is input according to an embodiment of the present invention.
FIG. 6 is a schematic structural view of a photographing direction variable camera according to a second embodiment of the present invention
7 is an exemplary diagram illustrating an operation of capturing an image with a camera when a touch is input according to the third embodiment of the present invention.
8 is an exemplary view showing an operation of capturing an image with a camera when touch input according to the fourth embodiment of the present invention

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims. And will be apparent to those skilled in the art.

FIG. 1 is a block diagram of a mobile device to which a device for distinguishing between a hand touch and a pen touch is applied in a touch screen according to an embodiment of the present invention. The mobile device shown in FIG. 1 exemplifies a mobile communication terminal.

Referring to FIG. 1, the mobile device 100 includes a display unit 190 and a display controller 195. The mobile device 100 includes a controller 110, a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input / output module 160, a sensor module 170, a storage unit 175, and a power supply unit 180. The sub communication module 130 includes at least one of a wireless LAN module 131 and a local communication module 132. The multimedia module 140 includes a broadcasting communication module 141, an audio reproduction module 142, (143). The camera module 150 includes at least one camera and the input / output module 160 includes a button 161, a microphone 162, a speaker 163, a vibration motor 164, a connector 165, (166). Hereinafter, the display unit 190 and the display controller 195 are respectively a touch screen and a touch screen controller.

The control unit 110 stores a ROM or a ROM 112 storing a control program for controlling the apparatus 100 and a signal or data input from the outside of the apparatus 100, And a RAM (RAM) 113 used as a storage area for a work to be performed. The CPU 111 may include a single core, a dual core, a triple core, or a quad core. The CPU 111, the ROM 112, and the RAM 113 may be interconnected via an internal bus.

The control unit 110 includes a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input / output module 160, a sensor module 170, A storage unit 175, a power supply unit 180, a touch screen 190, and a touch screen controller 195, as shown in FIG. In addition, according to a feature of the present invention, the controller 111 photographs an image with at least one camera of the camera module 150 at the time of touch input on the touch screen 190, and determines whether the electronic pen is recognized And controls it. The control unit 111 may further include a first touch panel for sensing an input of the electronic pen of the touch screen 190 and a second touch panel for sensing an input of a hand touch, (OFF) state of the panel. Also, the controller 111 controls the operation of performing a touch input operation on a panel other than the panel controlled to operate in the off state.

The mobile communication module 120 allows the mobile device 100 to be connected to an external device through mobile communication using at least one or more antennas (not shown) under the control of the controller 110. [ The mobile communication module 120 may communicate with a mobile phone 100 via a mobile phone with a phone number (not shown), a smartphone (not shown), a tablet PC or other device (not shown) , A text message (SMS), or a multimedia message (MMS).

The sub communication module 130 may include at least one of a wireless LAN module 131 and a local area communication module 132.

The wireless LAN module 131 may be connected to the Internet at a place where an access point (AP) (not shown) is installed under the control of the controller 110. [ The wireless LAN module 131 supports the IEEE 802.11x standard of the Institute of Electrical and Electronics Engineers (IEEE). The short-range communication module 132 may wirelessly perform short-range communication between the mobile device 100 and the image forming apparatus (not shown) under the control of the controller 110. [

The mobile device 100 may include at least one of a mobile communication module 120, a wireless LAN module 131, and a local communication module 132 according to performance. For example, the mobile device 100 may include a combination of a mobile communication module 120, a wireless LAN module 131, and a short range communication module 132 depending on performance.

The multimedia module 140 may include a broadcasting communication module 141, an audio reproducing module 142, or a moving picture reproducing module 143. The broadcast communication module 141 receives a broadcast signal (e.g., a TV broadcast signal, a radio broadcast signal, or a data broadcast signal) transmitted from a broadcast station through a broadcast communication antenna (not shown) under the control of the controller 110, (E. G., An Electric Program Guide (EPS) or an Electric Service Guide (ESG)). The audio playback module 142 may play back a digital audio file (e.g., a file having a file extension of mp3, wma, ogg, or wav) stored or received under the control of the controller 110. [ The moving picture playback module 143 may play back digital moving picture files (e.g., files having file extensions mpeg, mpg, mp4, avi, mov, or mkv) stored or received under the control of the controller 110. [ The moving picture reproducing module 143 can reproduce the digital audio file.

The multimedia module 140 may include an audio reproduction module 142 and a moving picture reproduction module 143 except for the broadcasting communication module 141. [ The audio reproducing module 142 or the moving picture reproducing module 143 of the multimedia module 140 may be included in the controller 110.

The camera module 150 includes at least one camera for capturing a still image or a moving image under the control of the controller 110.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) on the earth orbit and uses a time of arrival from a GPS satellite (not shown) to the mobile device 100 So as to calculate the position of the mobile device 100.

The input / output module 160 may include at least one of a plurality of buttons 161, a microphone 162, a speaker 163, a vibration motor 164, a connector 165, and a keypad 166.

A button 161 may be formed on the front, side, or rear of the housing of the mobile device 100 and may include a power / lock button (not shown), a volume button (not shown), a menu button, A back button, and a search button 161, as shown in FIG.

The microphone 162 receives a voice or a sound under the control of the controller 110 and generates an electrical signal.

The speaker 163 may transmit various signals (for example, a radio signal, a broadcast signal, a radio signal, a radio signal, a radio signal, a radio signal, and the like) of the mobile communication module 120, the sub communication module 130, the multimedia module 140, or the camera module 150 under the control of the controller 110. [ A digital audio file, a digital moving picture file, a picture taking, etc.) to the outside of the mobile device 100. [ The speaker 163 can output sound corresponding to the function performed by the mobile device 100 (e.g., a button operation sound corresponding to a telephone call or a ring back tone). The speaker 163 may be formed at one or a plurality of positions at appropriate positions or positions of the housing of the mobile device 100.

The vibration motor 164 can convert an electrical signal into a mechanical vibration under the control of the control unit 110. [ For example, when the mobile device 100 in the vibration mode receives a voice call from another device (not shown), the vibration motor 164 operates. And may be formed in the housing of the mobile device 100 in one or more. The vibration motor 164 may operate in response to the user's touching operation on the touch screen 190 and the continuous movement of the touch on the touch screen 190.

The connector 165 may be used as an interface for connecting the mobile device 100 to an external device (not shown) or a power source (not shown). The mobile device 100 transmits data stored in the storage unit 175 of the mobile device 100 to an external device (not shown) via a cable connected to the connector 165 under the control of the controller 110 Or from an external device (not shown). The mobile device 100 may receive power from a power source (not shown) through a wired cable connected to the connector 165, or may charge the battery (not shown) using the power source.

The keypad 166 may receive a key input from a user for control of the mobile device 100. The keypad 166 includes a physical keypad (not shown) formed on the mobile device 100 or a virtual keypad (not shown) displayed on the touch screen 190. The physical keypad (not shown) formed on the mobile device 100 may be excluded depending on the performance or structure of the mobile device 100. [

An earphone connecting jack (earphone connecting jack) 167 may be connected to the mobile device 100 by inserting an earphone (not shown).

The sensor module 170 includes at least one sensor for detecting the status of the mobile device 100. [ For example, the sensor module 170 may include a proximity sensor that detects whether the user is approaching the mobile device 100, a light sensor (not shown) that detects the amount of light around the mobile device 100, A motion sensor (not shown) that detects motion of the device 100 (e.g., rotation of the mobile device 100, acceleration or vibration applied to the mobile device 100), a point of the compass A gravity sensor for detecting the direction of action of gravity, and an altimeter for detecting the altitude by measuring the pressure of the atmosphere, . At least one of the sensors may detect the state, generate a signal corresponding to the detection, and transmit the signal to the control unit 110. The sensors of the sensor module 170 may be added or deleted depending on the capabilities of the mobile device 100.

The storage unit 175 is connected to the mobile communication module 120, the sub communication module 130, the multimedia module 140, the camera module 150, the GPS module 155, the input / And may store signals or data input / output corresponding to the operation of the touch panel 160, the sensor module 170, and the touch screen 190. The storage unit 175 may store control programs and applications for controlling the mobile device 100 or the control unit 110. [

The term "storage unit" includes a storage unit 175, a ROM 112 in the control unit 110, a RAM 113, or a memory card (not shown) Stick). The storage unit may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to one or a plurality of batteries (not shown) disposed in the housing of the mobile device 100 under the control of the controller 110. One or more batteries (not shown) supply power to the mobile device 100. In addition, the power supply unit 180 may supply power to the mobile device 100 from an external power source (not shown) through a wired cable connected to the connector 165. In addition, the power supply unit 180 may supply the mobile device 100 with power input from an external power source wirelessly through wireless charging technology.

The touch screen 190 may provide a user interface corresponding to various services (e.g., call, data transmission, broadcasting, photographing) to the user. The touch screen 190 may transmit an analog signal corresponding to at least one touch input to the user interface to the touch screen controller 195. The touch screen 190 can receive at least one touch through a touchable input means (e.g., a stylus pen) such as a user's body (e.g., a finger including a thumb) or an electronic pen 105. [ Also, the touch screen 190 can receive a continuous movement of one touch among at least one touch. The touch screen 190 may transmit an analog signal corresponding to the continuous movement of the input touch to the touch screen controller 195.

The touch input is not limited to direct contact between the touch screen 190 and the user's body or touchable input means, and may include non-contact. The touch screen 190 can be changed depending on the performance or structure of the mobile device 100. In particular, the touch screen 190 may include touch events caused by contact with a user's body or touchable input means, The touch event and the value (e.g., current value) detected by the hovering event can be output differently so that input (for example, hovering) in a non-contact state can be separately detected. The touch screen 190 preferably outputs a detected value (for example, a current value or the like) differently according to the space between the hovering event and the touch screen 190.

The touch screen 190 may be implemented by a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

Meanwhile, the touch screen controller 195 converts the analog signal received from the touch screen 190 into a digital signal (e.g., X and Y coordinates) and transmits the converted signal to the controller 110. The controller 110 may control the touch screen 190 using the digital signal received from the touch screen controller 195. For example, the control unit 110 may cause a shortcut icon (not shown) displayed on the touch screen 190 to be selected or a shortcut icon (not shown) in response to a touch event or a hovering event. Also, the touch screen controller 195 may be included in the control unit 110. [

In addition, the touch screen controller 195 can detect a value (e.g., a current value) output through the touch screen 190 to check the space between the hovering event and the touch screen 190, (For example, Z coordinate), and provides the converted distance value to the controller 110.

In addition, the touch screen 190 may include at least two touch screen panels (not shown) capable of sensing the user's body and the touch or proximity of the touchable input means, respectively, so that the user's body and input by the touch- . ≪ / RTI > The at least two touchscreen panels provide different output values to the touchscreen controller 195 and the touchscreen controller 195 recognizes different values input from the at least two touchscreen panels to determine the It is possible to distinguish whether the input is an input by a user's body or an input by a touchable input means.

2 is a detailed block diagram of a touch screen controller and a touch screen in FIG. Referring to FIG. 2, the touch screen 190 includes a display panel 190a, a first touch panel 190b, and a second touch panel 190c. The display panel 190a may be a panel such as an LCD, AMOLED, or the like, and displays various images according to various operation states of the mobile device 100, application execution, services, and the like.

The first touch panel 190b is an electromagnetic resonance (EMR) type touch panel, for example, for sensing an electronic pen touch. The first touch panel 190b is a touch panel in which a plurality of loop coils cross a predetermined first direction and a first direction An electromagnetic induction coil sensor (not shown) having a grid structure and disposed in the second direction, and an electronic signal processor (not shown) for sequentially providing AC signals having a predetermined frequency to the respective loop coils of the electromagnetic induction coil sensor . When the electronic pen 105 incorporating a resonant circuit exists in the vicinity of the loop coil of the first touch panel 190b, the magnetic field transmitted from the loop coil is applied to the resonant circuit in the electronic pen 105, . Based on this current, an induction magnetic field is generated from the coil constituting the resonance circuit in the electronic pen 105, and the first touch panel 190b detects the induction magnetic field in the loop coil in the signal reception state The approach position or the touch position of the electronic pen 105 is detected. In the embodiment of the present invention, it is possible to access and detect touch by using the electronic pen 105. In the embodiment of the present invention, Is used.

The second touch panel 190c is a capacitive touch panel, for example, for detecting a hand touch. The second touch panel 190c includes a thin metal conductive material (for example, ITO (Indium Tin Oxide) Etc.) to coat the surface of the glass and to store electric charge. When a surface of the second touch panel 190c is touched by an object, a predetermined amount of charge moves to the contact position by the static electricity, and the second touch panel 190c recognizes the amount of change of the current due to the movement of the charge, Position. The second touch panel 190c allows touch detection by hand.

The first touch panel controller 195a converts the analog signal received from the first touch panel 190b to the electronic pen 105 or touch sensed into a digital signal and transmits the digital signal to the controller 110. [ The second touch panel controller 195b converts the analog signal received by the hand touch detection from the second touch panel 190b into a digital signal (e.g., X, Y, Z coordinates) and transmits it to the control unit 110. [

The control unit 110 controls the display panel 190a, the first touch panel 190b, and the second touch panel 190c using the digital signals received from the first and second touch panel controllers 195a and 195b .

Hereinafter, the first touch panel will be referred to as an EMR sensing panel and the second touch panel will be described as a capacitive sensing panel.

FIG. 3 is a flowchart of a distinguishing operation of a hand touch and a pen touch in a touch screen according to an embodiment of the present invention, and may be performed under the control of the control unit shown in FIGS. 1 and 2. FIG.

Referring to FIG. 3, in step 300, the user receives a hand touch or a pen touch input from the user. At this time, the hand touch and / or the pen touch input may be a case where an unintentional hand touch input occurs together with a touch input of the electronic pen when the user performs a touch input using the electronic pen. Referring to FIG. 4A, when the user performs a touch input using the electronic pen, before the electronic pen approaches the display screen by the electronic pen approach distance of the first touch panel that senses the input of the electronic pen, A part of the user's hand may be touched on the screen. 4 (b), an unnecessary input 410 due to a hand-touch input that is not intended by the user is generated in addition to the electronic pen touch input 420 intended by the user.

In steps 300 to 302, at least one camera captures an image and recognizes the electronic pen in the captured image. In step 304, it is determined whether or not the electronic pen is recognized. Referring to FIG. 5, the camera can photograph an image when the hand touch input is performed as shown in FIG. 5 (a), and the camera can photograph the image when the pen touch is input as shown in FIG. 5 (b) . As shown in FIG. 5, after the image is photographed by the camera, the photographed image is recognized, and it is determined whether all or part of the electronic pen is included in the recognized image. If all or part of the electronic pen is included in the photographed image, it is determined that the electronic pen is recognized in the photographed image. At this time, determining whether all or a part of the electronic pen is included in the recognized image can determine the presence or absence of the electronic pen in the recognized image by recognizing the shape, color, and the like of the electronic pen.

If the electronic pen is recognized in the photographed image, step 306 is performed. If the electronic pen is not recognized in the photographed image, step 310 is performed.

If it is determined in step 304 that the electronic pen is recognized in the photographed image, the electrostatic capacity sensing panel that senses the hand touch input is operated in the off state in step 306. Accordingly, only the electrostatic capacity sensing panel for sensing the touch input and the EMR sensing panel for recognizing the touch input of the electronic pen among the EMR sensing panel operate in the ON state, so that the hand touch input is not recognized, Only the touch input of the touch panel is recognized.

After step 306, in step 308, the touch input operation of the electronic pen recognized by the EMR sensing panel operated in the on state is performed.

If it is determined in step 304 that the electronic pen is not recognized in the photographed image, the EMR sensing panel for sensing the electronic pen touch input is turned off in step 310. Accordingly, only the electrostatic capacity sensing panel for sensing the touch input and the electrostatic capacity sensing panel for recognizing the touch input of the hand among the EMR sensing panel are operated in an on state, and the electronic pen touch input is not recognized. .

After step 310, in step 312, the touch input operation of the hand recognized by the electrostatic capacity sensing panel which is operated in the on state is performed.

Referring to FIG. 3, the operation of the present invention determines whether or not the electronic pen is recognized through the captured image of the camera, and when the electronic pen is recognized in the determination result, the touch panel that recognizes the hand is turned off So that the touch input can not be recognized on the touch panel that recognizes the hand. In addition, when there is no touch input of the electronic pen and only a hand touch input is made, the touch panel for recognizing the electronic pen is operated to be in the off state, so that the touch panel for recognizing the electronic pen can not recognize the touch input.

According to the second embodiment of the present invention, at the time of touch input, the photographing direction of the camera can be adjusted to photograph the image.

The camera at this time may be a so-called 'tilt camera' in which the angle of the camera is manually or automatically adjusted.

Referring to FIG. 6A, the camera includes a camera 151 that automatically moves from the inside to the outside of the mobile device 100 when the touch is input, that is, Lt; / RTI > 6A shows that the camera 151 is positioned inside the apparatus before the touch input in the execution of the operation of the present invention and the solid line portion indicates that the camera 151 It is automatically moved to the outside for image capture, that is, it protrudes out of the apparatus and adjusts the photographing direction.

6 (b), the camera may be a camera 151 that can manually adjust a photographing direction by a user, and when a user applies force such as pulling or pushing, The camera 151 may be a camera 151 that is located inside the camera body 100 and can be moved outwardly, that is, protrudes outwardly, thereby manually adjusting the shooting direction. As shown in Fig. 6 (b), the camera 151 capable of manually adjusting the photographing direction may have a knob capable of moving the camera 151. Fig.

6 (c), the camera may be a camera 151 that can automatically adjust the shooting direction within the mobile device 100 when a touch is input. A dotted line portion shown in (c) of FIG. 6 indicates that the camera 151 operates inside the mobile device 100.

In the case of the mobile device 100 having a camera capable of adjusting the photographing direction as shown in FIG. 6, when photographing an image with a camera, the photographing direction of the camera is automatically or manually adjusted up, down, left, The image can be taken.

According to the third embodiment of the present invention, it is possible to determine whether or not the electronic pen is present by capturing an image at the time of touch input and recognizing a predetermined pattern, a pattern, or a specific light source preset in the captured image. When the camera photographs an electronic pen equipped with a specific light source set in advance as shown in Fig. 7 (a) or an electronic pen equipped with a predetermined pattern or pattern previously set as shown in Fig. 7 (b) Or a predetermined pattern or light source. At this time, when recognizing a predetermined pattern, pattern, or specific light source of the electronic pen, it can be determined that the electronic pen is recognized in the photographed image. The specific light source, the specific pattern, and the pattern facilitate the recognition of the electronic pen. Further, the specific pattern, pattern or specific light source is located in an area where camera recognition can be facilitated, and the position is set when the apparatus is manufactured.

According to the fourth embodiment of the present invention, when a touch input is performed in a mobile device having two cameras, only one preset camera is operated, or only one camera is selectively operated according to a preset reference, You can shoot. For example, when the present invention is applied to a mobile device having a first camera and a second camera, as shown in FIG. 8, the first camera and the second camera are set in advance, So that the image can be taken.

Any one of the preset cameras at this time can be set and manufactured at the time of manufacturing the apparatus, and can also be changed according to the setting of the user. In addition, the preset reference may be a camera that operates at the time of touch input according to the position at which the touch signal is generated such that a camera which can easily photograph images of a hand or / and a pen is selected according to the position of the touch input of the hand or / May be set.

As described above, the manufacture of a device having two cameras is structurally complicated and requires a lot of installation cost in comparison with a device having a single camera. Recently, however, There is an attempt to apply When the embodiment of the present invention is applied to such a 3D photographable device, the additional camera installation cost may not be incurred.

In addition, the camera applied to the present invention may be a camera installed in the mobile device 100 in such a form that the angle is inclined by a predetermined angle size at the time of manufacture so that the hand or / It is possible. In addition, the camera installed in the mobile device 100 in an inclined angle may be a camera capable of automatically adjusting the photographing direction inside the mobile device 100 of FIG. 6C, Or may be a camera installed in an inclined angle inside the apparatus 100. [ A camera installed on the apparatus in such a manner that the angle is inclined is easier to install and implement than a camera in which the angle is manually or automatically adjusted.

As described above, in the touch screen according to the embodiment of the present invention, a method of distinguishing a hand touch and a pen touch from each other and a configuration and an operation of the device can be performed. In the meantime, Various embodiments of the invention, as well as various modifications and variations, may be present. For example, in an operation of photographing an image with a camera and judging whether or not the electronic pen is recognized in the photographed image, an image can be photographed using a camera capable of adjusting the photographing direction. At this time, A light source or a specific pattern or pattern so that the operation of recognizing the electronic pen in the photographed image can be performed through recognition of a predetermined specific light source or a specific pattern or pattern of the electronic pen. When this is applied, the camera can perform an operation of adjusting the photographing direction to photograph an image of a predetermined light source or an electronic pen including a specific pattern or pattern to recognize the electronic pen, Can be improved.

Also, in the operation of photographing an image with a camera and judging whether the electronic pen is recognized in the photographed image, an image can be photographed by using two cameras. The electronic pen at this time is a predetermined light source or a specific pattern or pattern The operation of recognizing the electronic pen in the photographed image can be performed through recognition of a predetermined specific light source or a specific pattern or pattern of the electronic pen.

In addition, in the operation of photographing an image with a camera and determining whether the electronic pen is recognized in the photographed image, an image can be taken with two cameras, and the camera at this time can be a camera capable of adjusting the photographing direction. Further, the electronic pen at this time includes a predetermined specific light source or a specific pattern or pattern, so that the operation of recognizing the electronic pen in the photographed image can be performed through recognition of a predetermined specific light source or a specific pattern or pattern of the electronic pen have.

It will also be appreciated that embodiments of the present invention may be implemented in hardware, software, or a combination of hardware and software. Such arbitrary software may be stored in a memory such as, for example, a volatile or non-volatile storage device such as a storage device such as ROM or the like, or a memory such as a RAM, a memory chip, a device or an integrated circuit, , Or a storage medium readable by a machine (e.g., a computer), such as a CD, a DVD, a magnetic disk, or a magnetic tape, as well as being optically or magnetically recordable. It will be appreciated that the memory that may be included in the portable terminal is an example of a machine-readable storage medium suitable for storing programs or programs containing instructions for implementing the embodiments of the present invention. Accordingly, the invention includes a program comprising code for implementing the apparatus or method as claimed in any of the claims, and a machine-readable storage medium storing such a program. In addition, such a program may be electronically transported through any medium such as a communication signal transmitted via a wired or wireless connection, and the present invention appropriately includes the same.

Claims (11)

A method for distinguishing between a hand touch and a pen touch on a touch screen,
Determining whether the electronic pen is recognized in the photographed image by capturing an image with at least one camera at the time of touch input;
Operating a first touch panel for sensing input of an electronic pen and a second touch panel for sensing a touch input according to a result of the determination;
And performing the touch input operation on a panel other than the panel operated in the off state. 2. The method of claim 1, wherein taking the image with the at least one camera comprises:
And adjusting the photographing direction of the camera to photograph the image. 2. The method of claim 1, wherein taking the image with the at least one camera comprises:
Wherein when both of the two cameras are present, both of the two cameras operate to photograph an image, or only one of the two cameras, which is set in advance, is operated to photograph an image, And a pen touch. 2. The method of claim 1, wherein taking the image with the at least one camera comprises:
Wherein when the two cameras are present, only one camera selected in accordance with a preset reference among the two cameras operates to shoot an image. The method of claim 1, wherein the step of determining whether the electronic pen is recognized in the photographed image comprises:
Recognizing the photographed image;
And determining that the electronic pen has been recognized in the photographed image if the recognized image includes all or part of the electronic pen in the captured image. . The method of claim 1, wherein the step of determining whether the electronic pen is recognized in the photographed image comprises:
Recognizing a predetermined pattern or light source of the electronic pen in the photographed image;
And determining that the electronic pen has been recognized in the photographed image when recognizing the preset pattern or light source of the electronic pen. 2. The method of claim 1, further comprising the steps of: operating one of a first touch panel that senses the input of the electronic pen and a second touch panel that senses a hand touch input according to a result of the determination, ,
Causing the second touch panel to operate in an off state when the electronic pen is recognized in the photographed image;
And operating the first touch panel to turn off when the electronic pen is not recognized in the captured image. An apparatus for distinguishing between a hand touch and a pen touch on a touch screen,
A camera module including at least one camera for capturing a still image or a moving image;
A touch screen including a first touch panel for sensing the input of the electronic pen and a second touch panel for sensing the input of the hand touch;
The method of claim 1, further comprising: photographing an image with the at least one camera of the camera module when a touch is input on the touch screen; determining whether the electronic pen is recognized in the captured image; The touch panel and the second touch panel are operated in the OFF state and the operation of performing the operation of the touch input in the panel other than the panel operated in the OFF state is controlled Wherein the touch screen is a touch screen. 9. The camera module according to claim 8,
And a camera capable of manually adjusting a photographing direction. The apparatus for distinguishing between a hand touch and a pen touch in a touch screen. 9. The camera module according to claim 8,
And a camera capable of automatically adjusting a photographing direction. The apparatus for distinguishing between a hand touch and a pen touch in a touch screen. 9. The camera module according to claim 8,
And a camera installed on the apparatus in a shape in which the angle is inclined by a predetermined angle size.

Images