KR20070056706A - Communication device and method for receiving key input from operation sense-pen - Google Patents

Abstract

A communication terminal and a method for recognizing a key from an operation recognition pen are provided to enable a user to freely input various information without a touch screen regardless of a point of pen contact by recognizing a pen operation through short range communication and outputting a character or a picture. A communication terminal(230) comprises an information receiving part(420), an information recognition part(430), and a display part(451). The information receiving part(420) receives character or picture information, created from an operation recognition pen, using short range communication. In this case, the character or picture information is created in response to the motion direction of the operation recognition pen. The information recognition part(430) processes the received character or picture information and creates associated display information. The display part(451) displays the created display information in the form of a character or a picture.

Description

Communication terminal and method for recognizing keys from gesture recognition pen {Communication Device and Method for Receiving Key Input from Operation Sense-Pen}

1 is a view for explaining a conventional pen motion recognition method.

2 is a view for explaining a relationship between a gesture recognition pen and a mobile communication terminal according to an embodiment of the present invention.

3 is a block diagram illustrating the motion recognition pen of FIG. 2.

FIG. 4 is a block diagram illustrating the mobile communication terminal of FIG. 2.

5 is a view for explaining an example in which the operation of the pen is displayed in the communication terminal according to an embodiment of the present invention.

6 is a flowchart illustrating a pen motion recognition method according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

210: communication terminal

220: LAN

230: gesture recognition pen

The present invention relates to a key input device, and more particularly, to a key recognition method of a communication terminal for receiving and outputting text or picture information generated by an operation recognition pen without a touch screen.

In modern society, mobile communication terminals are widely used as a necessity for modern people as a means of convenient communication without regard to place. Recently, as the performance of the processor is improved and the resources of the memory are increased, the mobile communication terminal provides various functions as well as the conventional mobile communication service.

Recently, a mobile communication terminal has been widely used as a means of replacing a recording means such as an electronic notebook. Therefore, in addition to the input method using a conventional keypad, input methods for making a user's text (or picture) input easier are being actively researched and developed. As an example, there is a character input method using a touch screen.

1 is a view for explaining a conventional pen motion recognition method.

As shown in FIG. 1, when a user writes letters using the pen 120 on the surface of the display 110 of a terminal such as a PDA or a cellular phone, the user searches for a character corresponding to the shape of the letter and displays the display 110. Mark). Therefore, the user can store and maintain desired contents even if he / she does not write or write letters on the notebook one by one, and does not need to carry a large amount of documents.

However, the pen motion recognition method as described above has a risk that the surface of the display may be easily damaged and damaged when the pen tip is frequently touched since the terminal should always have a touch screen. In addition, when the touch screen is used for a long time, foreign matters or gloss may be deteriorated on the display unit, and thus, the user may not see a clear screen and may not use the pen motion well.

Another problem is that terminals such as mobile communication terminals are gradually miniaturized, so that it is difficult not only to input all the characters or pictures that a user wants in a small display unit, but also the display unit is so small that it is difficult to immediately check his / her written text. There are many restrictions on their use.

The present invention has been made to solve the problems of the prior art as described above, an object of the present invention is to receive and process the operation information of the pen using short-range communication to generate the corresponding display information to be divided into text or picture form It is to provide a communication terminal for outputting.

Another object of the present invention is to provide a gesture recognition pen which generates corresponding character information or picture information from a pen moving by a user and transmits it to a communication terminal using short-range communication.

Another object of the present invention is to detect the movement of the pen to recognize as a character or a picture and to generate the corresponding character information or picture information and to transmit to the communication terminal using short-range communication, the character corresponding to the operation of the pen in the communication terminal A key recognition method of a communication terminal displaying a picture form is provided.

According to an aspect of the present invention for achieving the object of the present invention as described above and to solve the above-described problems of the prior art, the communication terminal, the information received by the short-range communication to the character information or picture information generated from the gesture recognition pen Receiving unit; An information recognizing unit processing the information received by the information receiving unit to generate corresponding display information; And a display unit which displays the display information generated by the information recognition unit in the form of a character or a picture, wherein the character information or the picture information from the gesture recognition pen is information generated in response to the movement of the gesture recognition pen. It is done.

According to another aspect of the present invention, a motion recognition pen may include: a motion detection unit configured to generate a detection signal by detecting a motion of a moving pen; A detection signal identification unit for recognizing a detection signal generated by the motion detection unit as a text or a picture to generate corresponding text information or picture information; And a detection signal transmission unit for transmitting the information generated by the detection signal identification unit to a communication terminal using short-range communication.

According to another aspect of the present invention, there is provided a pen motion recognition method, comprising: generating a detection signal by sensing a motion of a moving pen; Recognizing the generated detection signal as a text or a picture to generate corresponding text information or picture information; Transmitting the generated information to a communication terminal using short-range communication; And displaying a character or a picture form corresponding to an operation of the moving pen in the communication terminal.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present invention is not limited or limited to the embodiments. Like reference numerals in the drawings denote like elements.

Hereinafter, exemplary embodiments of a pen motion detection apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In addition, for convenience of description, a mobile communication terminal among the communication terminals for receiving the operation information of the pen will be described as an example, but the technical idea of the present invention can be applied to wired and wireless communication terminals and electric and electronic devices in addition to the mobile communication terminal. It will be apparent to those skilled in the art.

2 is a view for explaining the relationship between the gesture recognition pen 210 and the mobile communication terminal 230 in the key input system 200 according to an embodiment of the present invention.

2, a key input system 200 according to an embodiment of the present invention includes a gesture recognition pen 210, a local area network 220, and a mobile communication terminal 230.

The key input system 200 transmits operation information of the gesture recognition pen 210 to a mobile communication terminal 230 such as a cellular phone, a PCS, a PDA, a DMB phone, and the like through a local area network 220 such as Bluetooth or infrared communication. It has been proposed to allow text or picture information through the gesture recognition pen 210 to be output through the mobile communication terminal 230.

To this end, the gesture recognition pen 210 according to an embodiment of the present invention generates a detection signal by detecting a motion of a pen moving by a user, and recognizes the generated detection signal as a character or a picture, and corresponding character information or picture information. To generate and transmit to the mobile communication terminal 230 using a local area network (220). The mobile communication terminal 230 may process the information received from the gesture recognition pen 210 to generate corresponding display information, and display the information in text or picture form using the output means of the mobile communication terminal 230. have.

Accordingly, even if there is no touch screen, it is possible to output a text or a picture by recognizing a pen motion through short-range communication, and the mobile communication terminal 230 may set the pen motion in advance to recognize the text and the picture separately. You can avoid confusing pictures.

The gesture recognition pen 210 is used as a means for writing or drawing letters by a user. The character is meant to include not only Korean characters but also multilingual characters, symbols, numbers, and the like. The text or picture generated by using the gesture recognition pen 210 may be set so that a user recognizes the text or picture using a predetermined key installed in the gesture recognition pen 210 in advance. In addition, an operation of the gesture recognition pen 210 may be transmitted to the local area network 220.

The local area network 220 is a communication means for receiving text information or picture information from the gesture recognition pen 210 and transmitting it to the mobile communication terminal 230. Bluetooth, infrared communication (IrDA), and UWB (Ultra Wide Band) may be used as the local area communication means that can be used in the local area network 220.

The mobile communication terminal 230 receives operation information of the gesture recognition pen 210 through the local area network 220 and visually expresses display information corresponding to the operation information, or if the operation information is a text, TTS. (Text To Speech) can be used to output voice.

In addition, the mobile communication terminal 230 is a PDC (Personal Digital Cellular) phone, PCS (Personal Communication Service) phone, PHS (Personal Handyphone System) phone, CDMA-2000 (1X, 3X) phone, WCDMA (Wideband CDMA) phone Communication such as Dual Band / Dual Mode phone, Global Standard for Mobile (GSM) phone, Mobile Broadband System (MBS) phone, Digital Multimedia Broadcasting (DMB) phone, Smart phone, mobile phone, etc. Features may include portable devices, public switched telephone network (PSTN) terminals, Voice over Internet Protocol (VoIP), Session Initiation Protocol (SIP), Media Gateway Control Protocol (MGCP), Media Gateway Control (MEGACO), and PDA (Personal) Digital Assistants, Hand-Held PCs, Notebook Computers, Laptop Computers, WiBro Terminals, MP3 Players, Mobile Devices such as MD Players, and International Roaming and Expanded Mobile Communication Services International Mobile Telecommunica provided by IMT-2000 tion-2000) A portable electric and electronic device, which means all kinds of handheld-based wireless communication devices, including a terminal, a Universal Mobile Telecommunication Service (UMTS) -based terminal, and the like, and includes a Code Division Multiplexing Access (CDMA) module and a Bluetooth ( It may be provided with a predetermined communication module, such as a wireless communication device equipped with a GPS chip to enable location tracking through a Bluetooth module, an Infrared Data Association, a wired / wireless LAN card, and a Global Positioning System (GPS). In other words, it is interpreted as a concept of collectively a terminal capable of performing a certain arithmetic operation by mounting a microprocessor capable of multimedia playback.

Hereinafter, an embodiment of the internal structures of the gesture recognition pen 210 and the mobile communication terminal 230 will be described in detail.

3 is a block diagram illustrating the motion recognition pen 210 of FIG. 2.

As shown in FIG. 3, the gesture recognition pen 210 includes a controller 310, a motion detector 320, a detection signal identification unit 330, a detection signal transmitter 340, and a near field communication unit 350. do.

The controller 310 generally controls each component of the gesture recognition pen 210.

The motion detector 320 detects a motion of a moving pen and generates a detection signal. When the pen is operated by the user, a sensing signal is generated. The motion may be sensed even when the pen is in a non-contact state, and may be detected even when the pen is in contact with an arbitrary surface, an object, or the like. Therefore, an acceleration sensor, an inertial sensor, or the like, which outputs three-dimensional acceleration values according to the pen's motion, may be used to detect the pen's motion by the motion detector 320. For example, by analyzing the acceleration values by the acceleration sensor, the movement direction of the pen can be known. That is, different pen motion information may be generated according to an acceleration value, a direction value, and the like detected by the acceleration sensor or the inertial sensor.

In addition, the motion detector 320 may include a pressure receiver that receives a pressure applied to a pen from a user in contact with an arbitrary position and a pressure sensor that detects the received pressure (not shown). In this case, since the pressure receiver may be easily worn in contact with the ground, the pressure receiver may be made of an elastic polymer material or a plastic material to increase durability. In addition, the pen movement recognition rate may be improved by using the stretchable material.

In addition, according to the pressure detected by the pressure sensor unit or the holding time of the pressure, the detection signal identification unit 330 may have different text information or picture information (for example, small dots / large dots, thin lines / thick lines). It is also possible to diversify the operation information by generating.

In addition, when the shape of a character or a picture is detected in the motion detection unit 320, the user may be provided with a light emitting diode unit that is powered on to determine whether the motion of the motion recognition pen 210 that the user operates is properly recognized. Can be provided directly (not shown). Illumination of the light emitting diode may be changed in proportion to the pressure.

The detection signal identification unit 330 recognizes the detection signal generated by the motion detection unit 320 as a text or a picture to generate corresponding text information or picture information. That is, even if a user scribbles a specific character, if the shape of the specific character and the character information previously stored in the database match within a predetermined range, the character information may be generated by recognizing the same character. In addition, even if the user draws the Mickey Mouse picture similarly using the motion recognition pen 210, if there is an overall matching part such as eyes, nose, mouth, and physique, the stored mascot picture information may be generated. As such, the process of generating the corresponding text information or the picture information may be performed in the mobile communication terminal 230, or the gesture recognition pen 210 may merely function to transmit a detection signal.

In addition, a predetermined key for recognizing only one character or picture may be installed in the gesture recognition pen 210 to set which object is detected before the user manipulates the gesture recognition pen 210 using the key. Therefore, according to the set key, the sensing signal identification unit 330 recognizes the sensing signal as a character or a picture, thereby minimizing the case of misunderstanding a character as a picture or a mistake as a picture.

In addition, the detection signal identification unit 330 may reduce power consumption and allow a long time to be used by switching to an electric saving mode when the pen operation is not detected for a predetermined time.

The detection signal transmission unit 340 transmits the information generated by the detection signal identification unit 330 to a communication terminal using short-range communication. A short range communication unit 350 may be provided as a means for transmitting the generated information, and may use Bluetooth, infrared communication, UWB, or the like.

The Bluetooth refers to a communication module of a standard that enables real-time communication in two directions by wirelessly connecting a computer, a mobile communication terminal, and a home appliance that are located at a short distance. In addition, the infrared communication may use the Infrared Data Association standard and the like, and refers to a technology for transmitting data in the infrared without a cable. The wireless infrared IrDA communication port has a function of transmitting and receiving digital information comparable to that of a LAN. In addition, UWB (Ultra Wide Band) is a wireless communication technology that utilizes a high frequency band of 2 to 10GHz, and UWB (UWB) can exchange data using ultra-high frequency and has a high transmission speed. It can be used as a wireless communication technology to implement a ubiquitous environment.

4 is a block diagram illustrating the mobile communication terminal 230 of FIG. 2.

Referring to FIG. 4, the mobile communication terminal 230 includes a control unit 410, an information receiving unit 420, a short range communication unit 425, an information recognizing unit 430, a user input unit 440, an output unit 450, The display unit 451 includes an audio output unit 452 and a wireless transceiver 460.

The controller 410 is responsible for the overall control of the components of the mobile communication terminal 110. In addition, the controller 410 typically includes a processor function for processing all data on a communication terminal associated with a modem digital signal processor (DSP). As more DSPs are provided to process internal signals, such as baseband signals, the operation of each mode may be faster due to the higher processing speed. In addition, the controller 410 may include a mobile station modem (MSM), a digital signal processor (DSP), an open multimedia application platform (OMAP), and the like.

The information receiving unit 420 receives the text information or the picture information generated from the gesture recognition pen 210 using short-range communication, and the text information or the picture information from the gesture recognition pen 210 is the motion recognition pen. Information generated in response to the movement of. In addition, the local area communication unit 350 may be included in order to use the local area communication. As described above, the local area communication may be performed with the gesture recognition pen 210 by installing a Bluetooth communication module or the like.

The information recognizing unit 430 processes the information received by the information receiving unit 420 to generate corresponding display information. In this case, when the information recognizing unit 430 does not receive the text information or the picture information for a predetermined time, the information recognizing unit 430 may switch to a specific mode. The specific mode may be at least one of predetermined modes executed in the mobile communication terminal 230 including an electric saving mode according to a user's selection. In addition, the specific mode may include a mode for gradually reducing the image output of the display unit 451, a mode for outputting with a weak brightness, a mode for switching to a previous menu from a current menu, a mode for outputting a warning message, and the like. .

The user input means 440 is a device for the user to input various commands, texts, pictures, etc. may be used in combination of one or more keypad, touch screen, touch pad, and voice recognition module. In particular, when the gesture recognition pen 210 according to the present invention is used, the gesture recognition pen 210 functions as a keypad or the like in the user input means 440.

The output means 450 is a device for outputting a character or a picture of the gesture recognition pen 210 to a user, and a visual output means such as an LCD, an organic LED, a PDP, an LED, and a ring tone included in the mobile communication terminal 230. At least one of audible output means such as speakers, earphones, and the like which can output various music such as coloring and MP3, and a vibration motor may be used.

The display unit 451, which is the visual output means, displays the display information generated by the information recognizing unit 430 in the form of a text or a picture. The text information may be output through the auditory output means using text to speech (TTS). That is, as the audio output unit 452, a speaker, earphone, or the like may be used, and the text information may be output as a voice so that the user may easily understand the input contents when the user is deaf.

The wireless transceiver 460 may perform a mobile communication service while transmitting and receiving radio waves with a base station.

5 is a view for explaining an example in which the operation of the pen is displayed on the mobile communication terminal 230 according to an embodiment of the present invention.

Referring to FIG. 5, a user may recognize a shape in the gesture recognition pen 210 by performing an operation such as writing or drawing a letter in the air using the gesture recognition pen 210. Alternatively, a letter or a picture may be written by contacting the end of the gesture recognition pen 210 with the ground or an object, and may be recognized by detecting a movement speed or a direction of movement of the gesture recognition pen 210. The shape may be transmitted to the mobile communication terminal 230.

As shown in FIG. 5, a letter 510 of 'ro' is written by the gesture recognition pen 210, and the mobile communication terminal 230 may output the content recognized by the display unit 451. In this manner, FIG. 5 illustrates a process of recognizing a string of 'the current Korean economy as the world's 12th largest' and visually displaying it, and inputting the last character 'ro' 510.

Hereinafter, the pen motion detection apparatus 200 according to the present invention described above with reference to FIGS. 2 to 4 will be described according to the steps of the operation process.

6 is a flowchart illustrating a pen motion recognition method according to an embodiment of the present invention.

First, the motion recognition pen 210 detects a motion of a moving pen to generate a detection signal (S610). The gesture recognition pen 210 recognizes the generated detection signal as a character or a picture (S620), and generates corresponding character information or picture information (S630). In addition, in the case of the touch sensing, the input information may be converted according to the detected pressure in order to generate the detection signal more precisely, or the pressure holding time for which the pressure is maintained may be sensed. In addition, it is possible to diversify the operation information by generating different character information or picture information according to the pressure holding time. The generated information is transmitted to the mobile communication terminal 230 using short-range communication (S640). Bluetooth, infrared communication, UWB, and the like may be used as the near field communication.

Next, the mobile communication terminal 230 receives the corresponding information of the detection signal recognized by the gesture recognition pen 210 through the short range communication (S650). If the text information or the picture information is not received for a certain time for a long time, it may be switched to a specific mode. In operation S660, the mobile communication terminal 230 displays a character or a picture form corresponding to the movement of the moving pen. In addition, in the case of the character information, it is also possible to output the voice through the speaker, earphones.

Accordingly, when the pen detects the motion of the pen to generate text information or picture information and transmits it to the communication terminal using near field communication, the communication terminal processes the received information and provides the user with the corresponding text or picture form. Can be.

Embodiments mentioned in connection with the gesture recognition pen 210 herein may be applied to the mobile communication terminal 230 and vice versa.

The pen motion detection method according to the present invention has been described so far, and the details mentioned in the embodiments of FIGS. 2 to 5 can be applied to the present embodiment as it is, and thus the detailed description thereof will be omitted.

The pen motion detection method according to the present invention can be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. The medium may be a transmission medium such as an optical or metal wire, a waveguide, or the like including a carrier wave for transmitting a signal specifying a program command, a data structure, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations are possible from such description.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and all the things that are equivalent to or equivalent to the claims as well as the following claims will belong to the scope of the present invention. .

As described above, in the communication terminal according to the present invention, even without a touch screen, a user may input a variety of information freely without restriction on the position at which the pen contacts, since the user can output a character or a picture by recognizing a pen operation through short-range communication. It has the effect of making it possible.

In addition, the user can set the operation of the pen to recognize the character and the picture separately to prevent the communication terminal from confusing the recognition of the character and the picture, there is an effect that can easily record the desired text or picture. .

In addition, even if the user does not use the gesture recognition pen for a certain period of time, the communication terminal that receives the gesture information from the pen or the pen can automatically switch to a mode set by the user, such as an electricity saving mode, so that the gesture recognition pen can be used more efficiently. It can be effective.

Claims (16)

An information receiver configured to receive text information or picture information generated from a gesture recognition pen using short-range communication; An information recognizing unit processing the information received by the information receiving unit to generate corresponding display information; And A display unit for displaying the display information generated by the information recognition unit in the form of a character or a picture Including, Character information or picture information from the gesture recognition pen is information generated in response to the movement direction of the gesture recognition pen. Communication terminal characterized in that. The method of claim 1, The information recognizing unit switches to a specific mode when the text information or the picture information is not received for a predetermined time. Communication terminal characterized in that. The method of claim 2, The specific mode is at least one of a predetermined mode executed in the communication terminal including an electric saving mode according to a user's selection Communication terminal characterized in that. The method of claim 2, And the text information is output through a predetermined audio output means using text to speech (TTS). A motion detector configured to detect a motion of a moving pen and generate a detection signal; A detection signal identification unit for recognizing a detection signal generated by the motion detection unit as a text or a picture to generate corresponding text information or picture information; And A detection signal transmission unit for transmitting the information generated by the detection signal identification unit to a communication terminal using short-range communication Motion recognition pen comprising a. The method of claim 1, The detection signal identification unit may be set to recognize the detection signal as a character or a picture using a predetermined key installed in the gesture recognition pen. Motion recognition pen characterized in that. The method of claim 1, The motion detector generates a three-dimensional sensing signal according to the movement of the moving pen by using an acceleration sensor. Motion recognition pen, characterized in that. The method of claim 5, The short-range communication, At least one of Bluetooth, infrared communication (IrDA), and UWB (Ultra Wide Band) Motion recognition pen characterized in that. The method of claim 5, If the motion detection unit does not detect the motion of the pen for a certain time, the motion detection unit is to switch to the electric power saving mode Motion recognition pen characterized in that. The method of claim 5, The light emitting diode unit which is powered on when the shape of a character or a picture is detected in the motion detection unit Motion recognition pen further comprising. The method of claim 5, The motion detection unit, A pressure receiver for contacting an arbitrary position to receive a pressure applied from the user to the pen; And Pressure sensor unit for sensing the received pressure Motion recognition pen further comprising. The method of claim 11, And the sensing signal identification unit generates different character information or picture information according to the pressure detected by the pressure sensor unit or the pressure holding time at which the pressure is maintained. The method of claim 11, And a light emitting diode unit whose illuminance changes in proportion to the pressure. The method of claim 11, The pressure receiving unit is a motion recognition pen, characterized in that the elastic polymer material or plastic material. Generating a detection signal by detecting a motion of a moving pen; Recognizing the generated detection signal as a text or a picture to generate corresponding text information or picture information; Transmitting the generated information to a communication terminal using short-range communication; And Displaying a character or a picture form corresponding to an operation of the moving pen in the communication terminal; Key recognition method of a communication terminal, characterized in that. A computer-readable recording medium having recorded thereon a program for executing the method of claim 15.

Images