KR101892638B1 - Mobile terminal - Google Patents

Abstract

A mobile terminal is disclosed. The mobile terminal may capture a display screen displayed on the touch screen and set the touch screen as a handwriting input means when the user performs a predetermined operation on the input unit, And generate a file containing the data and the captured image.

Description

[0001]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of performing various functions such as a memo function and a search function by using a handwriting input function.

As the functions of terminals such as a personal computer, a notebook computer, a mobile phone, and a smart phone are diversified, a multimedia device having multiple functions such as photographing and video shooting, playing music or video file, (multimedia player).

For functional support and enhancement of the terminal, it may be considered to improve the structural and / or software part of the terminal. Recently, a variety of terminals including a mobile terminal provide a complex and various functions, and the menu structure is also becoming complicated.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal capable of performing a memo function through handwriting input under any circumstances.

Another aspect of the present invention is to provide a mobile terminal capable of generating a memo file using a screen displayed on a display unit.

Another object of the present invention is to provide a mobile terminal capable of generating a memo file using a selected item among a plurality of items displayed on a display unit.

Another object of the present invention is to provide a mobile terminal capable of searching for a content based on received handwriting input and performing a predetermined function corresponding to an attribute of the retrieved content using the retrieved content .

Another aspect of the present invention is to provide a mobile terminal capable of capturing a screen displayed on a touch screen by a simple operation of a user and performing handwriting input on a captured image to perform a memo function.

Another object of the present invention is to provide a mobile terminal capable of storing data generated by using a touch screen as a handwriting input means by a simple operation of a user in association with an execution screen of a specific application displayed on a touch screen will be.

According to an aspect of the present invention, there is provided a mobile terminal including a touch screen and a controller. Wherein the control unit converts the received handwriting input into a memo file including at least one image and at least one text group when the handwriting input is received through the touch screen in a state in which the handwriting input function is activated, .

At this time, when the handwriting input function is activated, the control unit can deactivate the execution screen of the specific application while maintaining the execution screen of the specific application displayed on the touch screen. Also, the control unit may update the execution screen of the specific application while maintaining the disabled state of the execution screen of the specific application while the handwriting input function is activated.

In addition, when the handwriting input is received through the touch screen while the handwriting input function is activated, the control unit may include a captured image of the execution screen of the specific application in the memo file.

According to another aspect of the present invention, there is provided a mobile terminal including a display unit and a control unit. The display unit may display a plurality of items. Wherein the control unit is configured to deactivate a specific function corresponding to each of the plurality of items when the memo function is activated, to display at least one item selected from the plurality of items in the activated state of the memo function, And a text file containing at least one of the text groups.

At this time, when the plurality of items is an item included in the execution screen of a specific application, while the memo function is activated, the control screen updates the execution screen of the specific application while maintaining the deactivation state of the execution screen of the specific application can do.

According to another aspect of the present invention, there is provided a mobile terminal including a touch screen and a controller. The controller may search contents corresponding to the handwriting input received through the touch screen on which the handwriting input function is activated, and display the result of the search on the touch screen. At this time, when the searched content is selected, the controller may display a control area on the touch screen for performing a predetermined function corresponding to the searched content using the searched content.

According to another aspect of the present invention, there is provided a mobile terminal including: a touch screen; An input unit for generating input data; And a control unit for capturing a display screen of the touch screen in response to predetermined input data generated based on an operation on the input unit, generating data corresponding to a handwriting input received through the touch screen, And a control unit for activating a handwriting input function for generating a file including a captured image of a display screen of the touch screen.

According to another aspect of the present invention, there is provided a mobile terminal including: a touch screen for displaying an execution screen of a specific application; An input unit for generating input data; And a control unit for activating a handwriting input function through the touch screen in response to predetermined input data generated in the input unit, generating data corresponding to a handwriting input received through the touch screen, And a control unit for storing the program in association with an execution screen of the specific application displayed on the screen.

The user of the mobile terminal according to the present invention can perform a memo function through handwriting input under any circumstances.

Also, the user of the mobile terminal according to the present invention can generate a memo file using the screen displayed on the display unit.

In addition, the user of the mobile terminal according to the present invention can generate a memo file including a selected item among a plurality of items displayed on the display unit.

In addition, the user of the mobile terminal according to the present invention can search contents based on handwriting input, and further execute predetermined functions corresponding to attributes of the retrieved contents using the retrieved contents based on the handwriting input.

In addition, the user of the mobile terminal according to the present invention can quickly utilize the touch screen as a handwriting input means based on a simple operation such as a hot key operation, a software key operation, or the like for a hardware key.

In addition, the user of the mobile terminal according to the present invention can easily generate a memo file including data generated based on the display screen of the touch screen and handwriting input.

In addition, the user of the mobile terminal according to the present invention can easily store the data generated based on the handwriting input to the touch screen in association with the execution screen of the specific application displayed on the touch screen.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a flowchart illustrating a method of generating a memo file in a mobile terminal according to an embodiment of the present invention.
FIG. 3 shows a process in which a user activates a handwriting input function of the mobile terminal in a lock-screen according to the memo file generating method shown in FIG.
FIG. 4 shows a screen of the mobile terminal in a state in which the handwriting input function is activated according to the memo file generating method shown in FIG.
5 shows a process in which an execution screen of the SNS application inactivated due to the activation of the memo function is updated according to the execution process of the SNS application.
6 to 8 illustrate a process in which handwriting input received through the touch screen is stored as a memo file according to the memo file generating method shown in FIG.
FIG. 9 is a flowchart illustrating an example of a method of generating a memo file in the mobile terminal according to the present invention shown in FIG. 2. FIG.
FIGS. 10 to 11 illustrate a process of generating a memo file including text converted from handwriting input according to the memo generating method shown in FIG.
12 is a flowchart illustrating a handwriting input using method of a mobile terminal according to an embodiment of the present invention.
FIGS. 13 to 16 show a process in which the handwriting input using method shown in FIG. 12 is performed.
FIG. 17 is a flowchart illustrating another example of a memo file generation method in the mobile terminal according to the present invention shown in FIG. 2. FIG.
FIGS. 18 to 22 show the process of generating memo files according to the memo file generating method shown in FIG.
FIG. 23 is a flowchart showing another example of a memo file generation method in the mobile terminal according to the present invention shown in FIG. 2;
24 to 27 show an example of a process of generating a memo file according to the memo file generating method shown in Fig.
Figs. 28 to 29 show another example of a process of generating a memo file according to the memo file generating method shown in Fig.
30 is a flowchart showing an example of a memo file generating method shown in FIG.
31 to 32 show a process in which a mero file including a captured image of a part of an execution screen of a specific application is generated according to the memo file generating method shown in Fig.
33 is a flowchart showing an example of the memo file generating method shown in FIG.
34 to 35 show an example in which the memo file generating method shown in FIG. 33 is performed.
36 to 37 show another example in which the memo file generating method shown in Fig. 33 is performed.
38 shows a process of setting a style of handwriting input in response to a user's operation.
39 is a flowchart illustrating a method of generating a memo file according to another embodiment of the present invention.
FIGS. 40 to 43 show a process of performing an example of the memo file generating method shown in FIG.
44 to 46 illustrate the performance of another example of the memo file generating method shown in Fig.
47 is a flowchart illustrating a method of generating a memo file according to another embodiment of the present invention.
FIGS. 48 to 50 illustrate a process of generating the memo file shown in FIG. 47. FIG.
51 is a flowchart illustrating a method of generating a memo file according to another embodiment of the present invention.
52 to 57 illustrate a process in which an item displayed on the touch screen is searched based on a handwriting input received via a touch screen and a searched item is stored as a memo file according to the memo file generating method shown in Fig. .
58 is a flowchart illustrating a handwriting input using method according to an embodiment of the present invention.
59 to 61 show an example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in Fig.
62 to 63 show another example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in Fig.
FIGS. 64 to 66 show an example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in FIG. 58, and then a specific function predetermined for the searched content is performed.
67 to 69 show another example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in Fig. 58, and then a specific function predetermined for the searched content is performed.
70 is a flowchart showing still another example of a method of generating a memo file in the mobile terminal according to the present invention.
71 shows an example in which the handwriting input function using the touch screen is activated in response to the hardware hotkey operation by the user, according to the memo file generating method shown in Fig.
72 is a detailed view of the handwriting input screen shown in Fig.
73 shows that a mobile terminal according to the present invention is provided with a crop tool for changing the size of a captured image set in the background in a state in which the handwriting input function is activated.
74 shows a process of changing the size of the captured image provided in the background of the memo file based on a user's operation of the clap button in the mobile terminal according to the present invention in which the handwriting input function is activated.
75 shows an example in which the background of which size has been changed based on the user's operation is switched back to the entire area of the screen.
76 shows an example in which a capture image of a display screen of a touch screen is included in the background of a memo file in a state where the handwriting input function is activated in the mobile terminal according to the present invention.
77 shows a setting screen related to a virtual pen used to display a movement path of handwriting input in a state in which the handwriting input function is activated in the mobile terminal according to the present invention.
78 shows types of virtual pens, thickness of each pen, transparency of each pen, shape and transparency of a virtual eraser provided in the mobile terminal according to the present invention, and the like.
79 and 80 show an example in which the eraser function provided in the mobile terminal according to the present invention is performed.
81 is a flowchart illustrating an example of a file sharing method of a mobile terminal according to the present invention.
82 shows an example of a user interface provided for sharing a file according to the file sharing method shown in FIG. 81; FIG.
83 shows an example of a process of storing a file created based on the handwriting input function in the mobile terminal according to the present invention.
84 is a flowchart showing still another example of a memo file generation method in the mobile terminal according to the present invention.
85 shows a process of generating a memo file in the mobile terminal according to the present invention.
86 is a flowchart showing another example of a memo file generation method in the mobile terminal according to the present invention.
FIG. 87 shows that the speaker phone function is activated in the mobile terminal according to the present invention, in accordance with the memo file generating method shown in FIG.
88 is a flowchart showing still another example of a memo file generation method in the mobile terminal according to the present invention.
89 is a flowchart showing still another example of a method of generating a memo file in the mobile terminal according to the present invention.
90 shows a process of switching the display screen of the touch screen according to the memo file creation method shown in FIG.
FIG. 91 shows a process of inactivating a hardware key provided on the front side of the mobile terminal, with the handwriting input function activated in the mobile terminal according to the present invention.
92 is a flowchart showing still another example of a memo file generation method in the mobile terminal according to the present invention.
93 shows an example of a process of storing a file generated through a handwriting input screen according to the memo file generating method shown in FIG.
94 is a flowchart showing still another example of a memo file generation method in the mobile terminal according to the present invention.
95 shows a process in which the generated memo file is stored in association with the calendar application according to the memo file creation method shown in FIG. 94; FIG.
96 shows a virtual keyboard for generating a memo file in a mobile terminal according to the present invention.
97 is a view for providing a character recognition function for received handwriting input when the handwriting input function is activated in the mobile terminal according to the present invention.
98 is a flowchart illustrating an example of a handwriting input utilizing method of a mobile terminal according to the present invention.
FIG. 99 shows a process in which a file generated based on a handwriting history is stored in association with an execution screen of a specific application displayed on the touch screen, according to the handwriting input utilizing method shown in FIG.
100 shows that data stored corresponding to a specific person according to the process shown in FIG. 99 is displayed on the touch screen when the call application is executed for the specific person.
101 and 102 show another example of a process in which data generated based on handwriting input is stored in association with an execution screen of a specific application displayed on the touch screen, according to the handwriting input utilizing method shown in Fig.
103 is a flowchart showing another example of a handwriting input using method of a mobile terminal according to the present invention.
104 and 105 show a process in which the handwriting input function is activated and the received handwriting input is used in the state in which the e-book application is executed according to the handwriting input using method shown in Fig.
106 and 107 show a process in which the handwriting input function is activated and the received handwriting input is used in the state in which the calendar application is executed according to the handwriting input using method shown in FIG.
108 and 109 show a process in which the handwriting input function is activated and the received handwriting input is used in a state in which the calendar application is executed according to the handwriting input using method shown in FIG.
110 and 111 show a process in which the handwriting input function is activated and the received handwriting input is used in a state in which the messaging application is executed according to the handwriting input using method shown in FIG.
112 shows an example in which handwriting input is used based on the handwriting input function activated on the execution screen of the messaging application.
113 is a flowchart showing another example of a memo file generation method in the mobile terminal according to the present invention.
FIG. 114 shows an example of a change in the display screen of the touch screen according to the process of executing the handwriting input function according to the memo file generating method shown in FIG.
115 shows another example of the change of the display screen of the touch screen according to the process of executing the handwriting input function according to the memo file generating method shown in FIG.
116 shows another example of the change of the display screen of the touch screen according to the process of executing the handwriting input function according to the memo file generating method shown in FIG.
FIG. 117 shows an example in which a generation position of a file generated according to the memo file generation method shown in FIG. 113 is provided through a moving image playback screen.
118 is a flowchart showing still another example of a memo file generation method in the mobile terminal according to the present invention.
119 is a flowchart showing still another example of a method of generating a memo file in the mobile terminal according to the present invention.

The foregoing objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Like reference numerals designate like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, have. However, the scope of the present invention is not limited thereto.

1 is a block diagram of a mobile terminal 100 according to an embodiment of the present invention. 1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A storage unit 160, an interface unit 170, a control unit 180, and a power source unit 190, and the like. 1 are not essential, the mobile terminal 100 may have more or less components than those shown in FIG.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the storage unit 160.

The mobile communication module 112 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data in response to a voice call signal, a video call call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution) .

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. The location information module 115 may obtain location information using a global navigation satellite system (GNSS). Here, the Global Positioning System (GNSS) is a term used to describe the radionavigation satellite systems in which certain types of radionavigation receivers orbiting the Earth are transmitting reference signals that can determine their position near the surface or ground surface . The Global Positioning System (GNSS) includes Global Positioning System (GPS) in the United States, Galileo in Europe, GLONASS (Global Orbiting Navigational Satelite System) in Russia, COMPASS in China and Japan QZSS (Quasi-Zenith Satellite System), which is operated by the Ministry of Land, Infrastructure and Transport.

As a representative example of the GNSS, the location information module 115 may be a Global Position System (GPS) module. The GPS module calculates information on a distance (distance) from three or more satellites to a point (object), information on a time when the distance information is measured, and then applies a trigonometric method to the calculated distance information, Dimensional position information according to latitude, longitude, and altitude with respect to a point (object) in the three-dimensional space. Further, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module continuously calculates the current position in real time, and calculates velocity information using the current position.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the storage unit 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

As shown in FIG. 1, the A / V input unit 120 and the user input unit 130 may be implemented as one input unit 116. The various input data generated by the input unit 116 may be used to activate a handwriting input function through the display unit 151 implemented with a touch screen. Such input data may include an image received through the camera 121, a user's voice received through the microphone 122, a touch received through the display unit 151, and the like. However, the scope of the present invention is not limited thereto.

The sensing unit 140 senses the movement of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, And senses the current state of the terminal 100 to generate a sensing signal for controlling the operation of the mobile terminal 100. The sensing signal may be transmitted to the controller 180 so that the controller 180 may perform a specific function.

The sensing unit 140 may include a touch sensor for sensing whether the user touches the touch panel, a vibration sensor for sensing vibration generated based on the touch of the user, a gyro sensing rotation of the mobile phone 100, A sensor, an acceleration sensor, a geomagnetic sensor, or the like. However, the scope of the present invention is not limited thereto.

For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 may include a display unit 151, an acoustic output unit 152, an alarm unit 153, and a haptic module 154, for example, for generating an output related to visual, auditory, have.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

A proximity sensor may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen that is wrapped by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the cursor with the change of the electric field along the proximity of the cursor when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the storage unit 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, and the like) performed by the mobile terminal 100. The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like. Also, the sound output unit 152 may output sound through the earphone jack 116. The user can connect the earphone to the earphone jack 116 to hear the sound output.

The alarm unit 153 may output a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the audio output unit 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be configured to perform various functions such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through a jet opening or a suction opening, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The storage unit 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (e.g., a phone book, a message, a still image, The storage unit 160 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The storage unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the storage unit 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The interface unit 170 may include a card slot on which the card type user identification module can be mounted. Then, the user identification module may be connected to the mobile terminal 100 through the card slot. At this time, a plurality of user identification modules may be connected to the interface unit 170.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands A signal may be a path through which the signal is transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

Under the control of the control unit 180, the power supply unit 190 receives external power and internal power, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the storage unit 160 and executed by the control unit 180. [

The configuration of the mobile terminal 100 according to the present invention has been described above with reference to FIG. Hereinafter, the feature of the mobile terminal 100 according to the present invention performing the memo function will be described in more detail.

2 is a flowchart illustrating a method of generating a memo file in the mobile terminal 100 according to an embodiment of the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In response to the user's operation, the control unit 180 of the mobile terminal 100 activates a handwriting function using the touch screen 151 of the mobile terminal 100 (S100). In this specification, a user can perform a touch operation with respect to the touch screen 151 using a user's body part (e.g., a finger), a stylus pen, or the like, Input operation can be performed.

When the handwriting input function is activated, the control unit 180 deactivates the execution screen of the specific application displayed on the touch screen 151 (S110). For example, in the active state, a function corresponding to the specific area is performed by touching a specific area of an execution screen of a specific application. However, in a disabled state, a function corresponding to the specific area is performed It does not.

Here, the specific application may include not only an application for performing a specific function such as a telephone application, a memo application, a web browsing application, but also a driving application of the mobile terminal 100. [ Therefore, the execution screen of the specific application may be an execution screen of an application for performing a specific function, a lock-screen which is an execution screen of a driving application, an idle screen, or the like.

FIG. 3 illustrates a process of activating the handwriting input function of the mobile terminal 100 by the user in the lock-screen according to the memo file generating method shown in FIG. FIG. 4 shows a screen of the mobile terminal 100 in a state in which the handwriting input function is activated according to the memo file generating method shown in FIG.

Referring to FIG. 3, the user can activate the handwriting input function using the touch screen 151 by touching a soft key 151A corresponding to the handwriting input function displayed in the indicator area . 3, the user may activate the handwriting input function using the touch screen 151 by pressing the hardware key included in the mobile terminal 100. [

Hereinafter, the characteristics appearing on the screen 151 of the mobile terminal 100 when the handwriting input function is activated will be described with reference to FIG.

When the handwriting input function using the touch screen 151 is activated, the control unit 180 can reduce the transparency of the execution screen of the specific application and change the execution screen of the specific application to a semi-transparent state. Then, the user can recognize that the execution screen of the specific application is changed to a semi-transparent state, and recognize that the execution screen of the specific application is inactivated. 3, the controller 180 does not perform the lock release function for the mobile terminal 100 even if the user performs a touch operation to release the lock.

In addition, when the handwriting input function using the touch screen 151 is activated, the controller 180 displays a message window 151B asking whether to include the execution screen of the specific application on the screen 151 Can be displayed. When the user touches the selection button 151B 'of the message window 151B, the control unit 180 can generate a memo file using at least a part of the execution screen of the specific application. A method of generating a memo file using an execution screen of a specific application will be described in detail with reference to FIG. 23 to FIG.

When the handwriting input function using the touch screen 151 is activated, the control unit 180 displays a pop-up message including a message that the handwriting input function is activated, ) Window 151C on the screen 151 of the mobile terminal 100 for a predetermined period of time.

When the handwriting input function using the touch screen 151 is activated, the controller 180 displays a setting area 151D for selecting a line style generated through handwriting input on the screen of the mobile terminal 100 151). Here, the line style generated through handwriting input may include line color, line texture, line thickness, line transparency, and the like. However, the scope of the present invention is not limited thereto.

As a method of inactivating the activated handwriting input function, there are a method of again touching the soft key 151A corresponding to the handwriting input function with the handwriting input function being activated, a method of pressing the home button 151E , A method of pressing a back key, and the like. However, the scope of the present invention is not limited thereto.

3 and 4, when the execution screen of the specific application is updated according to the execution process, the control unit 180 maintains the deactivation state of the execution screen of the specific application, The execution screen of the specific application may be updated according to the execution process of the specific application.

5 shows a process in which an execution screen of the SNS application inactivated due to the activation of the memo function is updated according to the execution process of the SNS application. Referring to FIG. 5, as a new message is updated, a conventional message is executed and displayed, and it is known that a conventional message moves downward in a stepwise manner. Therefore, the user can confirm the execution process of the SNS application even when the handwriting input function is activated.

3 to 5, the handwriting input function of the mobile terminal 100 according to the present invention can be activated on a lock-screen or execution screen of a specific application. However, the handwriting input function of the mobile terminal 100 according to the present invention may be a function included in the memo application.

For example, when the memo application is executed and the handwriting input function is activated while the execution screen of the specific application is displayed on the touch screen 151, the user visually confirms that the execution screen of the specific application is updated, (For example, copying, pasting, cutting, and the like) on the handwriting input, or opening a memo file or performing an editing function on the memo file through the touch screen 151 can do. At this time, the execution screen of the memo application can be viewed as a transparent or semi-transparent virtual layer formed on the execution screen of the specific application and blocking the response of the specific application by touch. That is, while the handwriting input function is activated, the control unit 180 of the mobile terminal 100 can update the execution screen of the specific application while maintaining the disabled state of the execution screen of the specific application.

Referring again to FIG. 2, when the execution screen of the specific application is inactivated, the touch screen 151 receives a handwriting input generated based on a user's touch (S120). Then, the control unit 180 converts the received handwriting input into a memo file and stores the memo file (S130).

6 to 8 show a process of storing handwriting input received through the touch screen 151 as a memo file according to the memo file generating method shown in FIG. 6 to 8 illustrate a case where the control unit 180 of the mobile terminal 100 overlaps the inactivated lock-screen and the received handwriting input is converted into an image file, and a memo including the converted image Indicates the process of creating a file.

The user selects the handwriting input 151G displayed on the screen 151 of the mobile terminal 100 as shown in FIG. 7, the control unit 180 displays soft keys 151H1 and 151H2 on the screen 151 of the mobile terminal 100 for selecting a storage space of a memo to be generated.

The first soft key 151H1 of the soft keys 151H1 and 151H2 is a soft key for storing the memo file to be generated in a storage space interlocked with the memo application, This is a soft key for saving the file to the clipboard.

As shown in FIG. 7, when the user touches the first soft key 151H1, the generated memo file is stored in a storage space interlocked with the memo application. Then, the user can confirm the memo file generated by executing the memo application stored in the memo file as shown in FIG. Referring to FIG. 8, it can be seen that the memo file containing the handwritten input converted image 151I is stored in a storage space interlocked with the memo application.

FIG. 9 is a flowchart showing an example of a memo file generation method in the mobile terminal 100 according to the present invention shown in FIG. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In a state in which the handwriting input function is activated, the handwriting input is received through the touch screen 151 (S120). When the handwriting input is received through the touch screen 151, the control unit 180 of the mobile terminal 100 determines whether the handwriting input is convertible to text (S131). If the handwriting input is not convertible to text, the control unit 180 converts the handwriting input into an image (S132), generates a memo file including the converted image, and stores the memo file in the storage unit 150 .

However, if the handwriting input is convertible to text, the control unit 180 displays a pop-up window for selecting whether to convert the handwriting input into an image or text (S133). That is, if the handwriting input is convertible to text, the controller 180 displays a pop-up window for selecting the handwriting input conversion form. However, if it is not possible to convert the handwriting input into text, the controller 180 does not display a pop-up window for selecting the conversion form of the user on the screen 151 of the mobile terminal 100.

Then, the control unit 180 determines whether the user makes a selection for converting the handwriting input into text (S134). When the user makes a selection to convert the handwriting input to the image through the pop-up window, the controller 180 converts the handwriting input into an image (S132). However, if the user makes a selection for converting the handwriting input into text, the controller 180 converts the handwriting input to text (S135), generates a memo file including the converted text, 150).

9, when the handwriting input can be converted into text, the control unit 180 displays a pop-up window for selecting the conversion type of the handwriting input on the screen 151. [ However, according to an embodiment of the present invention, the controller 180 may convert the handwriting input to text directly without providing a pop-up window for selecting the handwriting input conversion style.

10 to 11 illustrate a process of generating a memo file including the text 151K converted from the handwriting input 151G according to the memo generation method shown in Fig.

10, when the handwriting input 151G can be converted into text, the control unit 180 of the mobile terminal 100 displays a pop-up window 151J for selecting a conversion type of the handwriting input And displays it on the screen 151. FIG.

As shown in FIG. 10, in the state that the pop-up window 151J is displayed, the user selects the handwriting input to be converted into text through the pop-up window 151J. Then, the control unit 180 converts the handwriting input into text, and generates and stores a memo file including the converted text. 11, the user can confirm the memo file including the text 151K in which the handwriting input is converted by executing the memo application.

2 to 11, a method of storing handwritten input received through the touch screen 151 as a memo file has been described. However, the mobile terminal 100 according to the present invention may convert the handwriting input into an image or text and temporarily store the handwriting input in the clipboard without storing the handwriting input as a memo file. Hereinafter, an example in which the handwriting input is stored and used in the clipboard will be described with reference to FIGS. 12 to 16. FIG.

12 is a flowchart illustrating a handwriting input using method of the mobile terminal 100 according to an embodiment of the present invention. Hereinafter, the handwriting input using method will be described with reference to necessary drawings.

In a state in which the handwriting input mode is activated, the handwriting input is received through the touch screen 151 (S120). Then, the control unit 180 of the mobile terminal 100 converts the handwriting input into text and / or image and stores it in the clipboard (S140). Depending on the setting, the text and / or image may be automatically stored in the clipboard or may be stored in the clipboard at the user's option. The process of converting the handwriting input may be performed in the same manner as or similar to the method described with reference to Figs. 2 to 11, and a detailed description thereof will be omitted.

If the converted text and / or image is stored in the clipboard, the control unit 180 executes a specific application based on the user's operation (S150). Here, the specific application is preferably an application capable of performing paste, delete, and copy functions for text, images, and the like.

In a state where the specific application is executed, the control unit 180 receives a long-touch on the execution screen of the specific application to the user (S160). Here, the user's long-touch corresponds to a right-clicking action of the mouse in the computing system.

Upon receiving the long-touch on the execution screen of the specific application, the control unit 180 causes the text and / or the image stored in the clipboard to be pasted on the execution screen of the specific application (paste Up window for displaying the pop-up window (S170). Then, when the user touches the pop-up window, the controller 180 performs a paste operation on the stored text and / or image (S180).

Hereinafter, an example of the handwriting input using method shown in FIG. 12 will be described with reference to FIG. 13 to FIG. FIGS. 13 to 16 show a process in which the handwriting input using method shown in FIG. 12 is performed.

Referring to FIG. 13, the user touches the second soft key 151H2 while the handwriting input 151G is displayed on the screen 151. FIG. Then, the control unit 180 converts the handwriting input 151G into text, and stores the converted text in the clipboard.

In a state where the converted text is stored in the clipboard, as shown in Fig. 14, after the user executes the schedule application, the execution screen of the schedule application is long-touched. 15, the control unit 180 displays a pop-up window 151M for attaching the text stored in the clipboard to the execution screen of the schedule application on the execution screen of the schedule application do.

15, when the user touches an area corresponding to the paste function in the pop-up window, the control unit 180 controls the operation of the pop- And pastes the text 151K onto the execution screen of the schedule application.

FIG. 17 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention shown in FIG. 17 is a flowchart illustrating a method of generating a memo file using both handwriting input received through the touch screen 151 and execution screens of a specific application displayed on the touch screen 151. [ Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In a state in which the handwriting input mode is activated, the handwriting input is received through the touch screen 151 (S120). Then, the control unit 180 of the mobile terminal 100 extracts a portion convertible to text in the handwriting input (S190).

Then, the control unit 180 converts the handwriting input portion that can not be converted into text into handwriting input into the image (S200), and converts the portion that can be converted into text into text or image (S210). The process of converting the handwritten input portion into text or image into text can be performed in the same manner as or similar to the method described with reference to Figs. 2 to 11, and a detailed description thereof will be omitted.

When the handwriting input is converted into text and / or image, the controller 180 generates a memo file including the converted text and / or image and stores the generated file in step S220.

Hereinafter, examples of the memo file generation method will be described with reference to FIGS. 18 to 22. FIG. FIGS. 18 to 22 show the process of generating memo files according to the memo file generating method shown in FIG.

Referring to FIG. 18, a user inputs a handwriting on the screen 151 of the touch screen 151. Then, the control unit 180 extracts the parts 151G, 151G1, and 151G2 convertible from the handwriting input to text, and regards the remaining part as a part 151G3 that can not be converted into text.

Referring to FIG. 19, the control unit 180 converts the entire handwriting input 151G, 151G1, 151G2, and 151G3 into images 151I, 151I1, 151I2, and 151I3, It can be seen that it is generated.

20, the control unit 180 converts only a part 151G1 of the handwriting input parts 151G, 151G1, and 151G2 convertible to text into text, converts the remaining parts 151G2 and 151G3 into an image, It can be seen that the handwritten input portion 151G3, which can not be converted into text, is converted into an image and then a memo file is generated based on the converted image.

Here, the portion 151G1 converted into text among the handwriting input portions 151G, 151G1, and 151G2 convertible to text may be determined according to the user's selection. That is, the control unit 180 writes at least a portion 151G1 of the portions 151G, 151G1, and 151G2 convertible to text among the received handwriting input 151G, 151G1, 151G2, and 151G3, . ≪ / RTI >

Referring to FIG. 21, the control unit 180 converts the handwriting input portions 151G, 151G1, and 151G2 that can be converted into text into a plurality of text groups 151K, 151K1, and 151K2, It can be seen that the portion 151G3 is converted into the image 151I3, and then the memo file is generated based thereon. Also, the controller 180 can recognize that the memo file has been generated in consideration of the position of the handwriting input.

21 and 22, it can be seen that the control unit 180 may not consider the position of the handwriting input in converting the handwriting input into text and / or image. At this time, as shown in FIG. 22, the user can select and move the converted text group in consideration of the position of the handwriting input.

In the method of generating a memo file and the handwriting input method in the mobile terminal 100 according to the present invention, only the handwriting input input by the user through the touch screen 151 is used. However, the mobile terminal 100 can perform functions similar to the method of generating the memo file and the handwriting input using the handwriting input and the execution screen of the specific application currently displayed on the touch screen 151 Hereinafter, a description will be made with reference to FIG. 23 to FIG.

23 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention shown in FIG. 23 is a flowchart illustrating a method of generating a memo file using both handwriting input received through the touch screen 151 and execution screens of a specific application displayed on the touch screen 151. [ Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In response to the user's operation, the control unit 180 of the mobile terminal 100 activates the handwriting input function using the touch screen 151 of the mobile terminal 100 (S100). When the handwriting input function is activated, the control unit 180 deactivates the execution screen of the specific application displayed on the touch screen 151 (S110)

After the execution screen of the specific application is deactivated, the touch screen 151 receives the handwriting input generated based on the touch of the user (S120). Then, the controller 180 generates a memo file including a captured image of the execution image of the specific application and stores the generated memo file (S230). At this time, the received handwriting input may be converted into text or image as described with reference to Figs. 2 to 22, and may be included in the memo file. Hereinafter, examples of the memo file generating method shown in FIG. 23 will be described with reference to FIGS.

24 to 27 show an example of a process of generating a memo file according to the memo file generating method shown in Fig.

24, when the user touches the soft key 151A corresponding to the handwriting input function, the control unit 180 activates the handwriting input function and deactivates the execution screen 151N of the specific application. Then, the control unit 180 may display a message window on the screen 151 asking the user to generate a memo file using the execution screen 151N of the specific application.

When the user selects the selection button 151B 'of the message window, the selection button 151B' is selected as shown in FIG. 25. Then, the controller 180 controls the touch screen 151 The execution screen 151N of the specific application can be used for generating the memo file.

In FIG. 25, the user inputs a handwriting 151G 'overlapping with the execution screen of the specific application, and then touches the first soft key 151H1 to store it. 26, the control unit 180 generates and stores a memo file including the captured image 151N 'of the execution screen of the specific application and the image 151I' converted from the handwriting input .

At this time, the capture image 151N 'of the execution screen of the specific application and the image 151I' converted from the handwriting input may be stored as one image merged with each other. As shown in FIG. 27, And may be included in the memo file while maintaining independence.

27, when the captured image 151N 'of the execution screen of the specific application and the image 151I' converted from the handwriting input are independent images, the user selects the image 151I ' ') Can be selected and moved. Although not shown in the drawing, the user may select the image 151I 'in which the handwriting input is converted, and perform functions such as copying and cutting. This also applies to the captured image 151N 'of the execution screen of the specific application.

Figs. 28 to 29 show another example of a process of generating a memo file according to the memo file generating method shown in Fig.

In FIG. 28, the user inputs a handwriting 151G overlapping with the execution screen of the specific application, and then touches the first soft key 151H1 to store the handwriting 151G. Then, as shown in FIG. 29, the controller 180 generates and stores a memo file including a captured image 151N 'of the execution screen of the specific application and the text 151K converted from the handwriting input. At this time, the handwriting input 151G may also be included in the memo file as an image merged with or independent of the captured image 151N 'of the execution screen of the specific application, as described with reference to FIGS. 26 to 27 .

30 is a flowchart showing an example of a memo file generating method shown in FIG. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In a state in which the handwriting input function is activated, the handwriting input is received through the touch screen 151 (S120). After the handwriting input is received, the control unit 180 of the mobile terminal 100 selects a part of the execution screen of the specific application displayed on the touch screen 151 in response to the user's operation (S240).

When a part of the execution screen of the specific application is selected, the control unit 180 generates a memo file based on a captured image of a part of the execution screen of the specific application and a handwriting input overlapping a part of the execution screen of the specific application (S250). At this time, the handwriting input portion overlapping with a part of the execution screen of the specific application may be converted into text and / or image based on whether the text input can be converted into text, and the memo file may be included.

31 to 32 illustrate a process in which a memo file including a captured image of a part of an execution screen of a specific application is generated according to the memo file generation method shown in Fig.

31 shows a case where a user inputs a handwriting 151G 'to the execution screen 151N of the specific application and then selects a part of the execution screen 151N of the specific application through a drag operation, Indicates that the first soft key 151H1 is touched.

Referring to FIG. 31, it can be seen that the unselected portion of the execution screen of the specific application displayed on the screen 151 is opaque. Therefore, the user can easily recognize a selected portion of the execution screen 151N of the specific application. 31, it can be seen that the user can vary the selected region by dragging the corner portion of the selected region.

When the user touches the first soft key 151H1, the control unit 180 determines whether or not the captured image 151N "of the selected portion of the execution screen of the specific region and the handwriting input 151N " And the memo file including the converted image 151I "is generated and stored. 26 and Fig. 32, it can be seen that the handwriting input portion which does not overlap the selected area of the execution screen of the specific application is not reflected in the memo file creation in the memo file shown in Fig.

33 is a flowchart showing an example of the memo file generating method shown in FIG. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In a state in which the handwriting input function is activated, the handwriting input is received through the touch screen 151 (S120). When the handwriting input is received, the control unit 180 of the mobile terminal 100 selects a part of the execution screen of the specific application displayed on the touch screen 151 in response to the user's operation (S240).

If a part of the execution screen of the specific application is selected, the control unit 180 extracts a portion not included in a part of the execution screen of the selected application during the handwriting input (S260) It is determined whether the handwriting input portion that is not included in a part is convertible to text (S270).

If the handwriting input that is not included in a part of the execution screen of the specific application can not be converted into text, the control unit 180 controls the handwriting input unit (S280).

However, if the handwriting input that is not included in a part of the execution screen of the specific application can be converted into text, the control unit 180 converts the handwriting input portion not included in a part of the execution screen of the specific application into text (S290 ), And the converted text is included in the generated memo file. Hereinafter, examples of the memo file generating method shown in FIG. 33 will be described with reference to FIGS. 34 to 37. FIG.

34 to 35 show an example in which the memo file generating method shown in FIG. 33 is performed.

34, in the state where the handwriting input 151G 'is overlapped on the execution screen 151N of the specific application on the screen 151 of the mobile terminal 100, Select some. Then, the handwriting input 151G 'is divided into a portion 151G'1 overlapping a part of the execution screen of the selected specific application and a portion 151G'2 not overlapping with a part of the execution screen of the selected specific application . In a state where the handwriting input 151G 'is divided, the user touches the first soft key 151H1 to generate a memo file.

Then, the control unit 180 of the mobile terminal 100 displays a captured image 151N "of a part of the execution screen of the selected specific application and a handwriting input 151G'1 overlapping a part of the execution screen of the selected specific application, 35, it can be seen that a memo file including the converted image 151I'2 is generated and stored, as shown in Figure 35. This is because the handwriting input portion 151G ' 2) is a part that can not be converted into text, it means that it is excluded in the image conversion.

36 to 37 show another example in which the memo file generating method shown in Fig. 33 is performed.

36, in a state in which the handwriting input 151G 'is overlapped on the execution screen 151N of the specific application on the screen 151 of the mobile terminal 100, the user selects the execution screen 151N of the specific application Select some. Referring to FIG. 36, it can be seen that the handwriting input 151G does not overlap with a part of the execution screen of the selected specific application. In this state, the user touches the first soft key 151H1 to generate a memo file.

Then, the control unit 180 of the mobile terminal 100 generates a memo file including the captured image 151N " of a part of the execution screen of the selected specific application and the text 151K converted from the handwriting input 151G1 37. This is because the handwriting inputting portion 151G is a portion that can be converted into text and therefore is converted into text even if it does not overlap with a part of the execution screen of the selected specific application 36 to 37. The control unit 180 considers handwritten input that can be converted into non-overlapping text on a part of the execution screen of the selected specific application at the time of generating the memo file It may not.

38 shows a process of setting a style of handwriting input in response to a user's operation. More specifically, FIG. 38 shows a process of changing the color of a line displayed on the screen 151 at the time of handwriting input.

Referring to the setting area 151D shown in FIG. 38, it can be seen that the mobile terminal 100 shown in FIG. 38 can display the handwriting input in the color selected by the user among the four colors. Also, when the user selects a specific color displayed in the setting area 151D, the color of the line displaying the handwriting can be changed.

Although not shown in the drawing, the mobile terminal 100 according to the present invention may provide a setting area for setting line thickness, line texture, line transparency, and the like generated through handwriting input. Further, when the handwriting input is converted into text, the mobile terminal 100 may provide a setting area for setting the font, size, color, thickness, etc. of the text.

39 is a flowchart illustrating a method of generating a memo file according to another embodiment of the present invention. 39 is a flowchart illustrating a method for selecting items displayed on the screen 151 of the mobile terminal 100 and generating a memo file using the selected items. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

 The controller 180 of the mobile terminal 100 displays a plurality of items on the screen 151 (S300). When the user selects a specific item and activates the memo function (S310) while the plurality of items are displayed on the screen 151, the control unit 180 deactivates the function corresponding to each of the plurality of items (S320).

For example, when the specific item displayed on the screen 151 is an item linked to a predetermined web site, if the memo function is activated, the control unit 180 controls the link operation to the predetermined web site . This is because the memo function is activated and the link function of the specific item is inactivated.

If the plurality of items is an item included in the execution screen of a specific application, the control unit 180 may execute the specific application while maintaining the deactivation state of the execution screen (i.e., a plurality of items) of the specific application According to the process, the execution screen (i.e., a plurality of items) of the specific application can be updated.

On the other hand, the selection of the specific item and the activation of the memo function may be performed at the same time, the specific item may be selected and then the memo function may be activated, or the specific item may be selected after the memo function is activated. Also, the selection of the specific item may be performed after the function of the plurality of items is deactivated.

After the specific item is selected and the memo function is activated, the control unit 180 converts the selected item into an image or text (S330), and generates and stores a memo file including the converted image or text . The conversion of the selected item to text or image can be determined based on the possibility of conversion of the selected item into text, as previously discussed. The memo file generated according to the memo file generation method shown in Fig. 39 may also be stored in at least one of the storage space and the clipboard linked with the memo application.

FIGS. 40 to 43 show a process of performing an example of the memo file generating method shown in FIG.

40, when the user long-touches the description part 151Y of the specific product corresponding to the image 151X of the specific product among the plurality of items displayed on the screen, the control unit 180 of the mobile terminal 100 displays The description part 151Y of the product is selected. Referring to FIG. 41, the description part 151Y of the specific product is selected and displayed dark.

41, when the user touches the soft key 151A for activating the memo function while the description part 151Y of the specific product is selected, the controller 180 activates the memo function , And deactivates a function corresponding to each of the plurality of items.

42, the control unit 180 may display a pop-up window 151J for selecting whether to store the description part 151Y of the selected specific product as text or as an image, (151). This is because the description part 151Y of the specific product has attributes convertible to text.

In Fig. 42, the user selects to convert the description part 151Y of the specific product into text. Then, the control unit 180 can recognize that the description part 151Y of the specific product is converted into text and a memo file including the converted text 151Y 'is generated, referring to FIG.

40 to 41, the user may activate the memo function by touching the soft key 151A for activating the memo function, and then, after the memo function is activated, By selecting the portion 151Y, it is possible to derive the same result as the result of the process shown in FIG. 40 to FIG.

On the other hand, in the memo file generating method shown in FIG. 39, since the memo file is not generated using the handwriting input, the screen on which the items are displayed need not be implemented by the touch screen. If the screen on which the items are displayed is not implemented on the touch screen, the user can select an item displayed on the screen or operate a soft key displayed on the screen using a mouse or a remote controller. This also applies to the memo file generating method shown in Fig.

44 to 46 illustrate a process of performing another example of the memo file generating method shown in FIG.

44, when the user long-touches an image 151X of a specific product among a plurality of items displayed on the screen, the control unit 180 of the mobile terminal 100 selects the image 151X of the specific product. Referring to FIG. 45, it can be seen that the image 151X of the specific product is selected and displayed dark.

When the image 151X of the specific product is selected, the user touches the soft key 151A for activating the memo function, as shown in FIG. Then, the control unit 180 can convert the image 151X of the specific product into an image, and generate a memo file including the converted image 151X ', referring to FIG.

47 is a flowchart illustrating a method of generating a memo file according to another embodiment of the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

 The controller 180 of the mobile terminal 100 displays a plurality of items on the screen 151 (S300). In a state where the plurality of items is displayed on the screen 151, the controller 180 activates the memo function in response to the user's operation and deactivates the function corresponding to each of the plurality of items (S340).

After the memo function is activated, the controller 180 selects a specific area of the screen 151 based on a drag operation on the screen of the user (S350). Then, the controller 180 converts an item included in the specific area into an image or text (S360), and generates a memo file including the converted image or text.

As previously noted, the conversion of the item to text and / or image may be determined based on the possibility of conversion of the selected item into text, and the generated memo file may be stored in at least one of the storage space and the clipboard associated with the memo application Lt; / RTI >

FIGS. 48 to 50 illustrate a process of generating the memo file shown in FIG. 47. FIG.

48, the user touches the soft key 151A for activating the memo function. Then, the control unit 180 of the mobile terminal 100 activates the memo function and deactivates the function corresponding to each of the plurality of items. Then, the user selects a specific area 151Z displayed on the screen 151 by dragging. 48, the control unit 180 converts the image 151X of the specific product included in the selected specific area 151Z and the description part 151Y of the specific product into an image or text .

Referring to FIG. 49, the controller 180 determines whether the image 151X 'of the specific product 151X included in the specific area 151Z has been converted and the description of a specific product included in the specific area 151Z It can be seen that the portion 151Y can generate a memo file including the converted text 151Y '.

Referring to FIG. 50, the controller 180 can generate a memo file including a captured image 151Z 'for the specific area 151Z.

51 is a flowchart illustrating a method of generating a memo file according to another embodiment of the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

 The controller 180 of the mobile terminal 100 displays a plurality of items on the touch screen 151 (S300). In a state where the plurality of items are displayed on the touch screen 151, the controller 180 activates the memo function in response to the user's operation and deactivates the specific function corresponding to each of the plurality of items (S370).

After the memo function is activated, if the handwritten input created by the user through the touch screen 151 is received (S380), the control unit 180 searches for an item corresponding to the received handwritten input among the plurality of items And displays the search result on the touch screen 151 (S390).

When the user selects a searched item displayed on the touch screen 151, the controller 180 converts the selected item into a memo file and stores the memo file (S395). As described above, the conversion of the selected item into text and / or image can be determined based on the possibility of conversion of the selected item into text, and the generated memo file is stored in at least one of the storage space and the clipboard associated with the memo application Can be stored in one.

52 to 57, an item displayed on the touch screen 151 is searched based on a handwriting input received through the touch screen 151 according to the memo file generating method shown in FIG. 51, As shown in FIG.

In Fig. 52, the user touches the soft key 151A for activating the memo function. Then, the control unit 180 of the mobile terminal 100 activates the memo function and deactivates the function corresponding to each of the plurality of items. Then, the user inputs the handwriting "stripe" through the touch screen 151 and touches the search soft key 151P.

53, the control unit 180 displays a pop-up window 151Q on the touch screen 151 for determining a range to search for a content corresponding to the received handwriting input do.

53, an object to be searched for contents corresponding to the received handwriting input may be an application running on the modern mobile terminal 100, a storage unit 160 of the mobile terminal 100, a world wide web web), and the like. However, the scope of the present invention is not limited thereto. For example, the item may be retrieved from other electronic devices such as a server on the network to which the mobile terminal 100 is connected, another mobile terminal, a PC, and the like.

As shown in FIG. 53, the user selects an application currently running on the mobile terminal 100 as a target to be searched for the content corresponding to the received handwriting input. 54, the control unit 180 searches for an item corresponding to the received handwriting input 'stripe' among a plurality of items included in the execution screen of the application, Is displayed on the touch screen 151. That is, it can be seen that the item 151R including the received handwriting input 'stripe' among the plurality of items is found on the touch screen 151. [

53, when a plurality of items are searched, the controller 180 may display a search result for a plurality of items on the touch screen 151. [ At this time, the controller 180 may collect the retrieved items and display the retrieved items on the touch screen 151 according to an embodiment of the present invention.

55, the user selects the area 151R 'including the item 151R including the received handwriting input' stripe 'by multi-touch dragging, and then selects the first soft key 151H1 for creating the memo file, . Then, the control unit 180 displays a pop-up window 151J on the touch screen 151 for selecting a conversion type of handwriting input, as shown in FIG. 55, the user may reduce the area on which the memo file is created after the item is retrieved.

56, the user selects an area for storing the selected area 151R 'as a memo composed of text and images in the pop-up window 151J. 57, the controller 180 stores the selected area 151R 'as a memo file composed of the cushion image 151R'1 and the text' yellow stripe 18,000 (151R'2) ' . Although the examples are not shown in the drawings, the items selected in the memo file generation method shown in Fig. 52 are determined as to whether to convert them into text and / or images based on the possibility of conversion of the selected items into text, And the generated memo file can be stored in at least one of the storage space and the clipboard associated with the memo application.

According to the memo file creation method described with reference to FIGS. 52 to 57, it can be seen that an item corresponding to the received handwriting input can be an item including a character recognized by the received handwriting input. However, the scope of the present invention is not limited thereto.

According to an embodiment of the present invention, the item corresponding to the received handwriting input may be an item including the meaning of the recognized character by the received handwriting input. For example, when the character 'pink' is recognized by the received handwriting input, the controller 180 transmits an item having a color 'pink' among the plurality of items displayed on the touch screen 151 to the received handwriting input You can also search by the corresponding item. If the character 'stripe' is recognized by the received handwriting input, the control unit 180 transmits an item including a 'stripe' pattern among a plurality of items displayed on the touch screen 151 to the received handwriting input You can also search by item.

According to another embodiment of the present invention, an item corresponding to the received handwriting input may be retrieved by a figure recognized by the received handwriting input. For example, when the heart shape is recognized by the received handwriting input, the controller 180 can search for an item including a heart shape as an item corresponding to the received handwriting input.

58 is a flowchart illustrating a handwriting input using method according to an embodiment of the present invention. Hereinafter, the handwriting input using method will be described with reference to necessary drawings.

The control unit 180 of the mobile terminal 100 activates the handwriting input function of the touch screen 151 based on the user's operation (S400). When the handwriting input function of the touch screen 151 is activated, the controller 180 may deactivate a specific function corresponding to at least one item displayed in the area set as the handwriting input area in the touch screen 151. According to an embodiment of the present invention, the handwriting input area may be the entire touch screen 151 or a part of the touch screen 151.

That is, when the handwriting input function of the touch screen 151 is activated, even if the user touches the item displayed in the handwriting input area of the touch screen 151, the function corresponding to the touched item is not performed. More specifically, if the handwriting input function of the touch screen 151 is activated while the execution icon of a specific application is displayed in the handwriting input area of the touch screen 151, even if the user touches the execution icon, Certain applications do not run.

 At this time, if the item displayed in the handwriting input area of the touch screen 151 is an item included in the execution screen of a specific application, the controller 180 can update the item according to the execution process of the specific application. For example, if the application being executed is a navigation application, the controller 180 may disable the touch function for the navigation application execution screen displayed in the handwriting input area, Can be updated.

If the execution screen of the navigation application is not displayed in the handwriting input area of the touch screen 151, the controller 180 may not deactivate the function corresponding to the touch of the navigation execution screen. Then, the user of the mobile terminal 100 can perform the content search using the handwriting input and control the execution of the navigation application through the touch operation.

When the handwriting input function of the touch screen 151 is activated and the handwriting input is received through the touch screen 151 at step S410, the controller 180 searches for a content corresponding to the received handwriting input , And displays the result of the search on the touch screen 151 (S420). Here, the content corresponding to the handwriting input may be searched in the mobile terminal 100, that is, the storage unit 160 of the mobile terminal 100. More specifically, the content corresponding to the handwriting input may be searched in the storage unit 160 corresponding to the application currently being executed in the mobile terminal 100.

In addition, the content corresponding to the handwriting input may be searched from another electronic device on the network to which the mobile terminal 100 is connected. That is, the controller 180 can retrieve contents corresponding to the received handwriting input from a server on a network connected to the mobile terminal 100, another mobile terminal, a PC, or the like. For example, the control unit 180 may search for a content corresponding to the handwriting input on the World Wide Web, which is connected to the mobile terminal 100 by wire or wirelessly.

When the content corresponding to the received handwriting input is searched and displayed on the touch screen 151, if the searched content is selected by the user in the state of being touched by the user, the controller 180 controls the searched content And displays a control area for performing a predetermined function in step S430. In step S440, the controller 180 performs a predetermined function corresponding to the retrieved content attribute in response to the touch on the control area.

59 to 61 show an example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in Fig.

In Fig. 59, the user touches the soft key 151A for activating the memo function. Then, the control unit 180 of the mobile terminal 100 activates the handwriting input function. Then, the user inputs the handwriting "kitty" through the touch screen 151 and touches the search soft key 151P.

60, the control unit 180 displays a pop-up window 151Q on the touch screen 151 for determining a range for searching for a content corresponding to the received handwriting input do.

As shown in FIG. 60, the user selects an application currently running on the mobile terminal 100 as a target from which content corresponding to the received handwriting input is searched. 60, the control unit 180 searches the memo file 151R1, which is the content stored based on the handwriting input, and displays the result of the search on the touch screen 151 .

62 to 63 show another example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in Fig.

62, the user inputs the handwriting 'Pony' in a state in which the handwriting input function of the touch screen 151 is activated, and then displays the web in the pop-up window 151Q as a target to be searched for the content corresponding to the handwriting input Select. 63, the control unit 180 displays the search result on the web on the touch screen 151 for the handwriting input 'Pony'. At this time, a web browser for searching contents corresponding to the handwriting input may be predetermined.

FIGS. 64 to 66 show an example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in FIG. 58, and then a specific function predetermined for the searched content is performed.

In FIG. 64, the user inputs handwriting 'Close to you' in a state in which the handwriting input function of the touch screen 151 is activated, and then, in the pop-up window 151Q, And selects the mobile terminal 100 which is a PC. 63, the control unit 180 may search the music file 151R2 in the storage unit 160 of the mobile terminal 100 for the handwriting input 'Close to you' (151). ≪ / RTI > At this time, the range in which the content corresponding to the handwriting input is retrieved in the storage unit 160 may be further limited to a storage area corresponding to a specific application.

In FIG. 65, the user touches and selects the searched music file 151R2. The control unit 180 then displays the control area 151S for controlling the playback of the searched music file 151R2 on the touch screen 151 as shown in FIG. Then, the user can control the playback of the searched music file 151R2 by touching the control area 151S.

If the searched content is a music file, the control unit 180 displays a control area including at least one application execution icon capable of playing the music file on the touch screen 151, unlike the one shown in FIG. 66 You may.

67 to 69 show another example of a process in which a content corresponding to handwriting input is searched according to the handwriting input using method shown in Fig. 58, and then a specific function predetermined for the searched content is performed.

67, the user inputs a handwriting 'Jack' in a state in which the handwriting input function of the touch screen 151 is activated, and then inputs the handwriting 'Jack' in the pop-up window 151Q to the tablet PC The mobile terminal 100 is selected. 68, the control unit 180 transmits the retrieved phone book file 151R3 in the storage unit 160 of the mobile terminal 100 to the touch screen 151 'for the handwriting input' Jack ' As shown in Fig.

In FIG. 68, the user touches and selects the searched phonebook file 151R3. 69, the control unit 180 controls the control area 151S1 for performing phone call, SMS message creation, and e-mail transmission function using the searched phonebook file 151R3 as a touch screen (151). ≪ / RTI > Then, the user can make a call to the counterpart corresponding to the searched phonebook file 151R3, write an SMS message, or write an e-mail through touching the control area 151S.

In the case where the retrieved content is a phone book file, the control unit 180, unlike the one shown in FIG. 69, uses at least one phonebook file capable of performing phone call, SMS message creation, e- A control area including an execution icon of the application may be displayed on the touch screen 151. [

If the searched content is a text file or a document file of a specific format, the control unit 180 may include an execution icon of an application executable to edit the text file or the document file of the specific format Can be displayed on the touch screen (151).

If the searched content is a moving image file, the control unit 180 may display a control area including the execution icon of the application capable of playing the moving image file on the touch screen 151. An example of the control area according to the attribute of the searched content is according to one embodiment of the handwriting input method according to the present invention, and the scope of the present invention is not limited thereto.

70 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

In response to the user's operation, predetermined input data is generated in the input unit 116 (S500). Here, the predetermined input data may be generated in response to a predetermined hotkey operation for a plurality of hardware keys included in the input unit 116. [ The predetermined input data may also be generated based on the recognized gesture of the user based on the image photographed through the camera 121 included in the input unit 116. [ Also, the predetermined input data may be generated based on a predetermined voice command of the user, which is received through the microphone 122 included in the input unit 116.

When the predetermined input data is generated, the control unit 180 of the mobile terminal 100 captures a display screen of the touch screen 151 (S510) and generates a captured image of the display screen. Then, the control unit 180 sets the touch screen 151 as a handwriting input means.

When the handwriting input is received through the touch screen 151, the controller 180 generates data based on the received handwriting input (S520). Here, the generated data may be an image corresponding to a handwriting input, or may be text including a character recognition result for the handwriting input, and may include both images and text generated based on the handwriting input.

Then, the controller 180 generates a memo file including the generated data and a captured image of the display screen of the touch screen 151 (S530). Here, the memo file may be one image file including the captured image and the generated data. Also, the memo file may be a file including the generated data that does not constitute one image with the captured image. For example, the memo file may be a file including the captured image and text generated based on the handwriting input. However, the form of the memo file in the present invention is not limited to the above-described examples.

When the memo file is generated, the controller 180 stores the generated memo file in a predetermined data storage area (S540). Here, the predetermined data storage area may be a specific area of the storage unit 160 that is predetermined to store the memo file generated as a result of performing the handwriting input function. In addition, the predetermined data storage area may be a specific area of the storage unit 160 allocated to a specific application displayed on the touch screen 151. In addition, the predetermined data storage area may be a specific area of the storage unit 160 designated by the user. However, in the present invention, the predetermined data storage area is not limited to the above-described examples.

70, the control unit 180 activates a handwriting input function using the touch screen 151 based on a predetermined type of touch received through the touch screen 151 It is possible. In addition, the controller 180 may activate the handwriting input function using the touch screen 151 based on the touch of the soft key displayed on the touch screen 151. [

The memo file used in the present specification does not mean a file generated as a result of execution of the memo application but refers to a file generated based on handwriting input using the touch screen 151 as a handwriting input means it means.

Fig. 71 shows an example in which the handwriting input function using the touch screen 151 is activated in response to the hardware hotkey operation by the user, according to the memo file creation method shown in Fig.

71 (a) shows that the user simultaneously presses the volume up key 131 and the volume down key 132, which are predetermined hardware hot keys. Then, the control unit 180 of the mobile terminal 100 recognizes the hot key operation, activates the handwriting input function using the touch screen 151, and, as shown in FIG. 71 (a) The handwriting input screen is displayed on the screen 151 of FIG. Referring to FIG. 71 (b), it can be seen that the captured image of the previous screen is displayed as the background screen (i.e., in the background) on the handwriting input screen. 71 (b), the user can use the touch screen 151 as a handwriting input means.

72 is a detailed view of the handwriting input screen shown in Fig. Referring to FIG. 72, the handwriting input screen includes a header area 151-1 and a content area 151-2. The header area 151-1 includes a plurality of icons 151-4 to 151-7 and a selection area 151-3 for selecting and performing a corresponding function.

The selection area 151-3 is an area for selecting whether to use the image of the display screen of the captured touch screen 151 in the background of the memo file while the handwriting input function is activated. In the mobile terminal 100 according to the present invention, it may be set to default to not use the captured image in the background when generating the memo file. The mobile terminal 100 may remember the last setting through the selection area 151-3 when the handwriting input function is activated.

The first icon 151-4 of the plurality of icons may be an icon for performing a function of setting the color or thickness of a virtual pen used to display the movement path of the handwriting input. The second icon 151-5 of the plurality of icons may be an icon for performing a function of deleting the handwriting input displayed in the handwriting input area. The third icon 151-6 of the plurality of icons may be an icon for performing a function for sharing the generated memo file with other electronic devices. The fourth icon 151-7 may be an icon for storing the generated memo file.

The content area 151-2 may be a region for receiving handwriting input (i.e., a handwriting input area). 71, the captured image of the display screen of the touch screen 151 may be displayed in the background in the content area 151-2. 72, a user interface 151-8 indicating that handwriting input can be performed through the handwriting input screen may be displayed on the handwriting input screen. The user interface 151-8 may be displayed in the content area 151-8 only for a predetermined time. 72, an icon adjacent to the user interface 151-8 and partially overlapped with the user interface 151-8 may be an icon for selecting whether or not to activate the hardware key disposed on the front side of the mobile terminal 100. [ The icon will be described in more detail with reference to FIG.

Even if the mobile terminal 100 is a terminal capable of switching between a horizontal view and a vertical view and the view direction at the time of activating the handwriting input function is changed to a different view direction, Can be maintained.

The handwriting input function can be deactivated by user's home key operation or back key operation. In addition, the handwriting input function may be deactivated in response to the hotkey re-operation used to activate the handwriting input function. At this time, even if the handwriting input function is terminated, the file generated through the handwriting input screen may be stored. The method of deactivating the handwriting input function in the present invention is not limited to the above examples.

FIG. 73 shows that, in the mobile terminal 100 according to the present invention, a crop tool for changing the size of the captured image set in the background in a state in which the handwriting input function is activated is provided.

As shown in FIG. 73 (a), the user touches any point in the handwriting input area. 73 (b), the control unit 180 of the mobile terminal 100 minimizes the header area 151-1 and displays it on the touch screen 151, and the four corners of the handwriting input area A crop button for changing the size of the captured image set in the background can be displayed.

As shown in FIG. 73 (b), when the user touches the minimized header area 151-1 'and drags the minimized header area 151-1' downward, the controller 180 displays the display screen of the touch screen 151 again It is possible to switch to the handwriting input screen of FIG. 73 (a). 73 (b), even if the user simply touches the minimized header area 151-1 ', the controller 180 returns the display screen of the touch screen 151 back to FIG. 73 To the handwriting input screen (a) of FIG.

74 shows a process of changing the size of the captured image provided in the background of the memo file based on the user's operation of the clap button in the mobile terminal 100 according to the present invention in which the handwriting input function is activated.

74 (a) shows that the user touches the lower right clap button and drags to the center of the screen when the handwriting input function is activated and the cropping tools for changing the size of the background screen are displayed at the four corners of the screen. Then, the controller 180 can change the size of the background screen as shown in FIG. 74 (b). If the finally generated file is stored, the size-changed captured image is set as a back-round of the generated file. At this time, the controller 180 may dim the area outside the captured image.

After the size of the captured image is changed, the user touches the minimized header area 151-1 'as shown in FIG. 74 (b). Then, the control unit 180 displays a handwriting input screen having a size-changed captured image set in the background on the touch screen 151, and restores the header area to its original size.

75 shows an example in which the changed background is switched back to the entire area of the screen. 75 (a), when the user double-touches the drag button displayed at a specific corner of the screen, or moves the touch for the area other than the size of the backround round to the changed background area, the controller 180 , The background can be extended again to the entire screen area as shown in Figure 75 (b).

76 shows an example in which the captured image of the display screen of the touch screen 151 is included in the background of the memo file in the state where the handwriting input function is activated in the mobile terminal 100 according to the present invention.

76 (a) shows that the user touches the selection area 151-3, which is an area for selecting whether to include the captured image in the background of the memo file. 76 (b), the control unit 180 of the mobile terminal 100 inserts the captured image into the selection display field of the selection area 151-3 in the background of the memo file Quot; V " type mark indicating that the function to be turned on is displayed. 76 (c), the user can perform handwriting input in the handwriting input area in a state where a captured image of the display screen of the touch screen 151 is included in the background.

If the user touches the selection area 151-3 again, the controller 180 may turn off the function and delete the 'V' mark in the selection display field. Also, the controller 180 may display the time information corresponding to the point in time when the function is turned on on the handwriting input screen.

77 shows a setup screen related to a virtual pen used to display a movement path of handwriting input in a state in which the handwriting input function is activated in the mobile terminal 100 according to the present invention.

77 (a) shows that the user touches the first icon 151-4 of the header area 151-1. 77 (b), the control unit 180 of the mobile terminal 100 displays the user interface 151-9 for setting the color and pen type for the virtual pen to the touch screen (151). Then, the user can select the color and pen type of the virtual pen through a touch to the user interface 151-9. 77 (b). When the user touches the first icon 151-4 again or touches the handwriting input area other than the user interface 151-9, the controller 180 displays the screen state of the touch screen 151 77 (a).

78 shows the types of virtual pens, the thickness of each pen, the transparency of each pen, the shape and transparency of a virtual eraser, and the like, which are provided in the mobile terminal 100 according to the present invention, . Referring to FIG. 78, it can be seen that various virtual pens whose thickness and transparency are different from each other can be provided in the mobile terminal 100. Referring to FIG. 78, the mobile terminal 100 is provided with a virtual eraser for erasing a specific size circle. However, examples of the virtual pen and the eraser provided in the present invention are not limited to the examples shown in Fig.

79 and 80 show an example in which the eraser function provided in the mobile terminal 100 according to the present invention is performed.

79 (a) shows that the user touches the second icon 151-5 for receiving the virtual eraser function. 79 (b), the control unit 180 displays a circular area in the handwriting input area, and when the user touches the circular area, the control unit 180 displays the circular area in the circular area Can be deleted. Although not shown in FIG. 79, the size of the circular area may be changed by the user's touch and drag operation or the like. In addition, the shape of the area provided for performing the eraser function is not limited to a circle.

80 (a) shows that the user again touches the second icon 151-5 with the eraser function activated. Then, the control unit 180 may provide a user interface for deleting the entire handwriting input, as shown in FIG. 80 (b). If the user touches the user interface, the control unit 180 can delete all the handwriting input displayed in the handwriting input area.

Although not shown in FIG. 80, when the user presses a back key, which is a hardware key, touches a handwriting input area other than the user interface, or touches the second icon 151-5 again, The display state of the touch screen 151 can be switched to the state of FIG. 80 (a).

81 is a flowchart showing an example of a file sharing method of the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

A file is created based on the activated handwriting input function (S600). Then, a touch of the user for sharing the generated file with another electronic device through the touch screen 151 is received (S610). Then, the controller 180 of the mobile terminal 100 displays a user interface on the touch screen 151 for sharing the generated file with other electronic devices (S620).

Then, a touch for a specific sharing method among various sharing methods provided through the user interface is received through the touch screen 151 (S630). Then, the controller 180 performs an operation for sharing the generated file with the other electronic device according to the selected specific sharing method (S640). In some cases, the controller 180 may further provide a user interface for performing the specific sharing method through the touch screen 151.

82 shows an example of a user interface provided for sharing a file according to the file sharing method shown in FIG. 81; FIG.

Figure 82 (a) shows that after a file is created based on the handwriting input function, the user touches the third icon 151-6 for performing the function of sharing the generated file with another electronic device . 82B, the control unit 180 displays a user interface 151-10, which can select various methods for sharing the created file with other electronic devices, on the touch screen 151, As shown in FIG.

Referring to FIG. 82 (b), the generated file sharing method includes a sharing method using a short-range wireless communication method such as Bluetooth, a sharing method using a social network service, a sharing method using a messaging service, Sharing method and the like can be included. Meanwhile, when the generated file is shared through a messaging service or an e-mail service, the generated file can be shared with another electronic device in the form of a created message or an attached file of an e-mail. However, the file sharing method performed by the mobile terminal 100 according to the present invention is not limited to the above-described examples.

83 shows an example of a process of storing a file created based on a handwriting input function in the mobile terminal 100 according to the present invention.

83 (a) shows that a file is created based on the handwriting input function, and then the user touches the fourth icon 151 - 7 for storing the generated file. Then, the control unit 180 may provide a user interface for selecting the type of application corresponding to the data storage space in which the generated file is stored, as shown in FIG. 83 (b). As shown in FIG. 83 (b), when the user selects the 'notebook' application, the controller 180 may store the generated file in a data storage area corresponding to the 'notebook' application.

83, when the user touches the fourth icon 151-7 after the file is generated based on the handwriting input function, the control unit 180 determines whether or not the icon The generated file may be stored in a predetermined data storage space without providing a user interface as shown in FIG.

In addition, the mobile terminal 100 according to the present invention may store the generated file in a data storage space provided in the mobile terminal 100, May be stored in an external device connected to the network. At this time, the user interface shown in FIG. 83 (b) may further include the external device.

84 is a flowchart showing still another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

The power supply to the touch screen 151 is blocked (S700). In such a state, the user operates the hotkey set to activate the handwriting input. Then, the control unit 180 recognizes the hot key operation (S710), supplies power to the touch screen 151, and activates the handwriting input function through the touch screen 151 (S720).

In step S730, the controller 180 displays a user interface on the touch screen 151 to select whether the captured image of the display screen of the touch screen 151 is included in the generated file. Then, the user can select whether to include the captured image in the generated file through the user interface, and then perform handwriting input and generate a file based thereon.

85 shows a process of generating a memo file in the mobile terminal 100 according to the present invention.

85 (a) shows that the user operates the hotkey for activating the handwriting input function in a state in which the power supplied to the touch screen 151 is cut off. 85, the controller 180 of the mobile terminal 100 supplies power to the touch screen 151 to switch the state of the mobile terminal 100 to the lock screen state Switch.

When the user releases the lock screen state, the control unit 180 displays the user interface 151-12 on the touch screen 151 indicating that the handwriting input function is activated, as shown in (c) of FIG. 85 . As shown in (c) of FIG. 85, the user interface may include a selection area for setting the user interface not to be displayed again.

After a predetermined time has elapsed after the user interface 151-12 is displayed or the user selects the selection area, the user inputs a handwriting into the handwriting input area as shown in (d) of FIG. 85 You can then create a memo file.

85, when the hotkey operation is recognized while the power supply to the touchscreen 151 is interrupted, the controller 180 supplies power to the touchscreen 151 and, in the locked screen state, You can also activate the input function. At this time, the controller 180 may display on the touch screen 151 a user interface for selecting whether to set a captured image of the lock screen image in the background of a memo file to be generated in the future. This is because the lock screen screen provides only simple information such as date, time, and the like, so that the lock screen screen itself is low in value as information, so that the user can select whether to set it in the background of the memo file.

Also, the control unit 180 can activate the handwriting input function even when the hot key is operated in the locked screen state. At this time, the controller 180 may display a user interface on the touch screen 151 to select whether to set a captured image of the lock screen screen in the background of a memo file to be generated in the future.

84 and 85, the user of the mobile terminal 100 according to the present invention operates the hot key even when the power supply to the touch screen 151 is cut off or in the lock screen state You can quickly activate the handwriting input function.

86 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

While the call application is being executed, the hotkey operation for activating the handwriting input function is recognized (S800). Then, the control unit 180 of the mobile terminal 100 activates the speaker phone function of the mobile terminal 100 (S810) and activates the handwriting input function through the touch screen 151 (S820). Then, the user can make a call using the speaker phone function, so that handwriting input through the touch screen 151 can be easily performed.

FIG. 87 shows that the speaker phone function is activated in the mobile terminal 100 according to the present invention, in accordance with the memo file generating method shown in FIG.

Referring to FIG. 87 (a), the controller 180 of the mobile terminal 100 not only displays the call application related information 151 - 13 on the touch screen 151, but also indicates that the speaker phone function is activated And displays the user interface 151-14 indicating the user. When the user touches the user interface 151-14, the speaker phone function may be inactivated. Then, the user interface 151-14 is switched to the display state at the lower end of Figure 87 (b).

88 is a flowchart showing still another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

A call reception event occurs when the handwriting input function is activated (S900). Then, the control unit 180 of the mobile terminal 100 switches the display screen of the touch screen 151 to the execution screen of the call application (S910). This is because, in general, the basic but most important function of the mobile terminal is the call function.

After the call application is executed, the control unit 180 checks whether the call application is terminated (S920). If the call application is terminated, the controller 180 switches the display screen of the touch screen 151 back to the handwriting input screen (S930). Then, the user can continue the file creation process utilizing the handwriting input function. However, if the call application is not terminated, the control unit 180 maintains the state of the display screen of the touch screen 151 (S940).

89 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

When a handwriting input function is activated, a predetermined specific event occurs (S1000). Then, the control unit 180 of the mobile terminal 100 additionally displays a user interface for notifying the occurrence of the specific event on the handwriting input screen for a predetermined period of time (S1010).

Then, the controller 180 checks whether a touch for the user interface is received within the predetermined time (S1020). If the user's touch on the user interface is not received within the predetermined time, the controller 180 removes the user interface displayed on the handwriting input screen (S1030).

However, if a touch for the user interface is received within the predetermined time, the controller 180 switches the display screen of the touch screen 151 to the execution screen of the application corresponding to the specific event (S1040). Then, when the application corresponding to the specific event is terminated, the controller 180 switches the display screen of the touch screen 151 to the handwriting input screen (S1050). Then, the user can continue the file creation process utilizing the handwriting input function.

FIG. 90 shows a process of switching the display screen of the touch screen 151 according to the memo file generating method shown in FIG.

90 (a) shows a case where a chat request is received, which is a predetermined specific event while the handwriting input screen is displayed on the touch screen 151, a chat request is displayed on the handwriting input screen displayed on the touch screen 151 Indicates that the user interface 151-15 indicating addition is displayed additionally.

90B shows that the display screen on the touch screen 151 is switched from the handwriting input screen to the execution screen of the chat application when a user's touch on the user interface 151-15 is received .

FIG. 90 (c) shows that the display screen of the touch screen 151 is switched from the execution screen of the chat application to the handwriting input screen when the chat application is terminated.

On the other hand, it is desirable that the specific event applied in FIGS. 89 and 90 is a less important event than the handwriting input function. For example, the specific event may include not only a chat request event but also a schedule alarm event or a message reception event having a relatively low importance of real-time response, as described above. Meanwhile, in the mobile terminal 100 according to the present invention, the specific event can be changed by a user.

91 shows a process of inactivating a hardware key provided on the front side of the mobile terminal 100 when the handwriting input function is activated in the mobile terminal 100 according to the present invention.

FIG. 91 (a) illustrates a case where a handwriting input function is activated in the mobile terminal 100, a handwriting input screen includes a user interface 151-16 for deactivating a hardware key disposed in a front portion of the mobile terminal 100 ) Is displayed. In Figure 91 (a), a plurality of hardware keys 133 are arranged at the lower end of the handwriting input screen.

91 (a), the user touches the user interface 151-16. 91 (b), the control unit 180 of the mobile terminal 100 deactivates the plurality of hardware keys 133, and the plurality of hardware keys 133 May be additionally displayed on the user interface 151-17 indicating that the user interface 151-1 has been deactivated. Also, the controller 180 may display the user interface 151-17 on the handwriting recognition screen only for a predetermined time.

The hardware key disposed on the front side of the mobile terminal 100 may include a hardware key type key and a hardware key that operates based on a touch. However, the scope of the present invention is not limited thereto.

92 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

When the handwriting input function is activated by a user's hotkey operation or the like, the control unit 180 captures a display screen of the touch screen 151 and acquires specific information corresponding to the display screen of the touch screen 151 (S1100) .

Here, the specific information corresponding to the display screen may include attribute information of the display screen. For example, the specific information corresponding to the display screen may be a URL (Uniform Resource Locator) of a specific web page displayed on the touch screen 151.

The information corresponding to the display screen may be information extracted from the information displayed on the display screen. For example, the extracted information may include a telephone number and an e-mail address displayed on the display screen. The type of the information extracted from the display screen can be determined according to which application the execution screen of the display screen is.

The handwriting input of the user is received through the handwriting input screen of the touch screen 151 (S1110). Then, the control unit 180 generates a file based on the received handwriting input (S1120), and stores the obtained information together with the generated file in the storage unit 160 (S1130).

93 shows an example of a process of storing a file generated through a handwriting input screen according to the memo file generating method shown in FIG.

In the state of FIG. 93 (a) in which the web browsing screen is displayed on the touch screen 151, the handwriting input function is activated. 93 (b), the control unit 180 activates the handwriting input function and captures the web browsing screen. Then, the control unit 180 acquires specific information "URL of the web browsing screen" from the web browsing screen, .

Then, the user touches an icon (an icon in a dotted line) for storing the generated file, as shown in Figure 93 (b). The control unit 180 then stores the captured image 151-18 of the web browsing screen and the URL 151-19 of the web browsing screen in the memo application as shown in (c) of FIG. 93 Able to know.

94 is a flowchart showing still another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

With the handwriting input function activated, the handwriting input is received through the handwriting input screen (S1200). Then, the control unit 180 generates a memo file based on the received handwriting input (S1210), and displays a user interface for storing the generated memo file in association with the specific application on the touch screen 151 S1220). Then, the control unit 180 stores the created memo file in association with the selected application through the user interface (S1230). On the other hand, the specific application may be an application corresponding to the display screen of the touch screen 151, or may be a predetermined application with an application associated with the handwriting input function.

95 shows a process in which the generated memo file is stored in association with the calendar application according to the memo file creation method shown in FIG. 94; FIG.

95 (a) shows a user interface 151-20 for storing a memo file based on handwriting input received through a handwriting input screen and storing the generated memo file in association with a specific application And indicates that the user has selected the calendar application in the user interface 151-20.

Then, as shown in FIG. 95 (b), the control unit 180 displays the user's selection time 151-21 and the user interface 151-22 in which the generated memo file is stored in association with the calendar application And displays it on the touch screen 151. Figure 95 (c) shows that the generated memo file is associated with the calendar application and is stored in a date corresponding to the user's selection point.

96 shows a virtual keyboard for generating a memo file in the mobile terminal 100 according to the present invention.

96 (a) shows that when a user operates a specific hotkey, the web browsing screen displayed on the touch screen 151 is captured, and the user has touched a specific icon while the memo file generating function is activated. 96 (b), the control unit 180 displays a virtual keyboard 151-24 for inputting characters of the user on the touch screen 151, and the virtual keyboard 151-24, On the touch screen 151, an area 151-23 for displaying characters inputted through the touch screen 151. [ For reference, the controller 180 may extract a URL corresponding to the web browsing screen and additionally display the extracted URL in the area 151-23.

97 shows that the mobile terminal 100 according to the present invention provides a character recognition function for received handwriting input when the handwriting input function is activated. Referring to FIG. 97, the control unit 180 provides a user interface 151-25 through the touch screen 151 to select whether to activate a character recognition function for received handwriting input. Utilizing this character recognition function, the control unit 180 may generate a file including text recognized based on the received handwriting input as well as a file including an image corresponding to the received handwriting input.

98 is a flowchart illustrating an example of a handwriting input utilizing method of the mobile terminal 100 according to the present invention. Hereinafter, the handwriting input utilizing method will be described with reference to necessary drawings.

When the execution screen of the specific application is displayed on the touch screen 151, predetermined input data is generated through the input unit 116 (S1300). Then, the control unit 180 of the mobile terminal 100 activates the handwriting input function through the touch screen 151 and receives the handwriting input through the touch screen 151 (S1310).

Then, the control unit 180 generates data corresponding to the received handwriting input (S1320), and stores the generated data in association with the execution screen of the specific application displayed on the touch screen 151 (S1330 ).

99 shows an example of a process in which data generated based on a handwriting history is stored in association with an execution screen of a specific application displayed on the touch screen 151 according to the handwriting input utilizing method shown in FIG.

99 (a) shows a state in which a handwriting input function is activated while a call application is executed and a call is transmitted to a specific person. 99 (b) shows that the user touches the fourth icon 151-7 for generating the data corresponding to the handwriting input after inputting the handwriting on the handwriting input screen. Then, as shown in FIG. 99 (c), the control unit 180 can store the data generated based on the handwriting input as the information corresponding to the specific person.

100 shows that data stored corresponding to a specific person according to the procedure shown in FIG. 99 is displayed on the touch screen 151 at the time of execution of the call application for the specific person.

Referring to FIG. 100 (b), when call origination is attempted for the specific person, the control unit 180 notifies that the data 151-26 stored in advance for the specific person is displayed on the call application execution screen have. 100 (a) shows an execution screen of the call application when there is no data stored in advance for the specific person.

99 and 100, the control unit 180 transmits data generated on the basis of the activated handwriting input function on the execution screen of the call application to the specific person, It can be stored in association with a specific person.

101 and Fig. 102 show another example of a process in which data generated based on handwriting input is stored in association with an execution screen of a specific application displayed on the touch screen 151, according to the handwriting input utilizing method shown in Fig. 98 .

101 (a) and 101 (b) show an example in which the handwriting input function is activated in a state in which the execution screen of the contact application is displayed on the touch screen 151, and the handwriting input function is activated Is input.

101 (c) shows that the user touches the icon 151-7 for generating data based on the handwriting input, with the handwriting input in the handwriting input area. 102 (a), the control unit 180 determines whether the mobile phone number recognized as the result of the character recognition of the handwriting input is to be overwritten with the mobile phone number previously stored for the specific person The user interface 151-27 on the touch screen 151 can be displayed.

In FIG. 102 (a), the user touches the 'OK' button. Then, the control unit 180 can recognize that the mobile phone number recognized based on the handwriting input is overwritten with the existing mobile phone number of the specific person, and the user interface 151-29 indicating the result can be displayed have.

101 and 102, the control unit 180 transmits data generated based on the activated handwriting input function on the execution screen of the contact application for the specific person to the mobile phone of the specific person displayed in the contact application It can be stored in association with a number. That is, when the character recognition result of the handwriting input matches the format of the specific input data in the contact application, the control unit 180 may store the character recognition result as specific input data corresponding to the specific person.

103 is a flowchart showing another example of a handwriting input using method of the mobile terminal 100 according to the present invention. Hereinafter, the handwriting input using method will be described with reference to necessary drawings.

When a specific unit area of a specific content composed of a plurality of unit areas is displayed on the touch screen 151, predetermined input data predetermined by the input unit 116 is generated (S1400). As noted above, the specific input data may be generated based on a predetermined hotkey operation.

On the other hand, the specific content may be e-book content composed of a plurality of pages. In this case, the unit area of the specific content may be a unit page constituting the e-book content. In addition, the specific content may be a text document composed of a plurality of pages. In this case, the unit area of a specific content may be a unit page constituting the text document. However, in the present invention, the specific contents and specific unit areas thereof are not limited to the above examples.

When the predetermined input data is generated, the control unit 180 activates the handwriting input function through the touch screen 151 and receives the handwriting input through the touch screen 151 (S1410). Then, the control unit 180 generates data corresponding to the received handwriting input (S1420), and stores the generated data as data corresponding to the specific unit area (S1430).

104 and 105 show a process in which the handwriting input function is activated and the received handwriting input is used in the state in which the e-book application is executed according to the handwriting input using method shown in Fig.

104A and 104B show that the handwriting input function is activated while the e-book application is executed and a specific page is displayed on the touch screen 151, and the user has input handwriting into the handwriting input area. 104C shows that the user touches the icon 151-7 for generating data based on the handwriting input in the state in which handwriting is input in the handwriting input area.

Then, the control unit 180 stores the generated data as data corresponding to the specific page. 105 (a) shows a screen on which the e-book application is executed, with the generated data stored as data corresponding to the specific page. 105 (a), a user interface 151-30 indicating that a memo file corresponding to the specific page exists is additionally displayed on a specific page of the e-book application displayed on the touch screen 151 .

The user touches a specific area of the user interface 151-30 as shown in Figure 105 (a). Then, the control unit 180 may additionally display the memo file stored in advance corresponding to the specific page on the specific page. Meanwhile, when the user touches the 'X' mark displayed on the user interface 151-30, the controller 180 may delete the user interface 151-30 from the specific page.

105, the memo file stored in advance corresponding to the specific page may not be hidden but may be displayed together with the specific page.

106 and 107 show a process in which the handwriting input function is activated and the received handwriting input is used in the state in which the calendar application is executed according to the handwriting input using method shown in FIG. 106 (a) and 106 (b) show that the handwriting input function is activated while the calendar application is executed and its execution screen is displayed on the touch screen 151, indicating that the handwriting is input by the user into the handwriting input area. 106 (c) shows that the user touches the icon 151-7 for generating data based on the handwriting input, with the handwriting input in the handwriting input area.

Then, the control unit 180 recognizes that the handwriting input is a schedule created for Friday including December 14, 2011, which is the same day, by performing character recognition on the handwriting input, The data can be recognized as data corresponding to the recognized date. 107 (a) shows a user interface (151-310) displayed on the touch screen 151 for storing the generated image data on November 16, 2012, which is the recognized date.

In FIG. 107 (a), the user touches an OK button of the user interface 151-30. 107 (b), the controller 180 stores the generated image data in a schedule corresponding to the recognized date, and then touches the user interface 151-31 ' And can be displayed on the screen 151.

106 and 107, when the handwriting input function is activated and the handwriting input is received in a state in which the calendar application is activated, the control unit 180 transmits data generated based on the handwriting input to the calendar You can see that it can be saved in association with the selected date on the application's launch screen. Here, the control unit 180 selects a date recognized as a handwriting recognition result for the handwriting input as a selected date on the execution screen of the calendar application.

108 and 109 show a process in which the handwriting input function is activated and the received handwriting input is used in a state in which the calendar application is executed according to the handwriting input using method shown in FIG.

108 (a) and 108 (b) show that the handwriting input function is activated when the calendar application is executed and its execution screen is displayed on the touch screen 151, indicating that the handwriting is input by the user into the handwriting input area. 109 (a) shows that the user touches the icon 151-7 for generating data based on the handwriting input in the state where the handwriting is input in the handwriting input area.

Then, the controller 180 performs character recognition on the handwriting input, and then stores the character recognition result as data corresponding to December 14, 2011, which is the selected date on the execution screen of the calendar application. 109 (b) shows a case where, when the next calendar application in which the character recognition result is stored is executed and the selected date is selected in the execution screen of the calendar application, the stored character recognition result 151-32 is stored in the calendar application It indicates additionally displayed on the execution screen.

110 and 111 show a process in which the handwriting input function is activated and the received handwriting input is used in a state in which the messaging application is executed according to the handwriting input using method shown in FIG.

110 (a) and 110 (b) show that the handwriting input function is activated in the state where the messaging application is executed and its execution screen is displayed on the touch screen 151, and the handwriting is input by the user into the handwriting input area. Then, in the state (a) of Figure 110, the user indicates that the user touches the icon 151-7 for generating data based on the handwriting input.

Then, the control unit 180 generates data corresponding to the handwriting input, and stores the generated data in association with the selected message transmission / reception counterpart in the execution screen of the messaging application. For example, the control unit 180 may store the generated data in the contact information of the sending / receiving party. Here, the generated information may be a character recognition result for the handwriting input, and may be image data corresponding to the handwriting input.

111 shows that the generated data is stored as contact information of the messaging counterpart, and when the message is received from the user, the stored information is displayed together with the messaging counterpart related information.

112 shows an example in which handwriting input is used based on the handwriting input function activated on the execution screen of the messaging application.

112 (a) shows that the handwriting input function is activated in a state where the messaging application is executed, and the user inputs a handwriting into the message input field of the execution screen of the messaging application. Then, the user touches a message transmission button as shown in FIG. 112 (a).

Then, as shown in FIG. 112C, the controller 180 generates image data corresponding to the handwriting input, and transmits the generated image to the messaging counterpart.

113 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

If the user manipulates a predetermined hotkey to activate the handwriting input function during video playback, the control unit 180 recognizes the hotkey operation (S1500). Then, the control unit 180 captures a moving picture screen, acquires a moving picture capturing time, and activates a handwriting input function (S1510). At this time, the control unit 180 sets the touch screen 151 as a handwriting input means while displaying the moving picture on the touch screen 151 (S1520).

113, the handwriting input function is activated based on the hotkey operation, but the controller 180 activates the handwriting input function based on the soft key operation, the user's specific gesture recognition, the voice command of the user, It is possible. This is also true in FIGS. 118 and 119, which will be discussed later.

The control unit 180 may set the entire touch screen 151 as a handwriting input unit or a part of the touch screen 151 as a handwriting input unit. In addition, the control unit 180 may set a separate handwriting input area on the touch screen 151, which is different from the moving picture display area. Examples in which the touch screen 151 is set as a handwriting inputting means will be described in more detail with reference to FIG. 114 to FIG.

When the touch screen 151 is set as a handwriting input means, the controller 180 displays various items for performing a handwriting input function and data generated during a handwriting input function on the touch screen 151 (S1530). Here, various items for performing the handwriting input function may include an icon for performing a specific function, a selection area, and the like. On the other hand, the data generated during the handwriting input function may include the time of activating the handwriting input function, the image of the captured moving picture screen, and the like. However, the scope of the present invention is not limited thereto.

If the handwriting input is received through the touch screen 151 while the touch screen 151 is set as the handwriting input means, the controller 180 generates a file based on the received handwriting input (S1540) , And stores the generated file on the basis of the user's operation (S1550). Here, the controller 180 may acquire storage time information of the generated file and additionally store the storage time information. The capturing time information of the obtained moving picture screen and the storing time information of the generated file may be displayed on the touch screen 151 when the user opens the stored file in the future.

Meanwhile, the control unit 180 may store the generated file in a data storage area related to a moving image playback file, or in a data storage area related to a memo application.

FIG. 114 shows an example of a change in the display screen of the touch screen according to the process of executing the handwriting input function according to the memo file generating method shown in FIG.

Referring to (a) of FIG. 114, it can be seen that the moving picture time is 5 minutes and 20 seconds elapsed. At this point, the user operates a hot key for activating the handwriting input function. Then, the control unit 180 sets the entire touch screen 151 as a handwriting input area, as shown in (b) of FIG. For reference, in (b) of Figure 114, a separate layer for handwriting input is created on the moving picture playback screen.

114 (a) and 114 (b), when the touch screen 151 is set as the handwriting input area, the control unit 180 controls the moving picture playback The operation is continued and the result is displayed on the touch screen 151. In addition, the controller 180 may display an icon 151-39 for storing the activation time of the handwriting input function (i.e., the cooperative image capturing time information 151-39) and the handwriting input 151-40, Can be displayed.

115 shows another example of the change of the display screen of the touch screen 151 according to the process of executing the handwriting input function according to the memo file generating method shown in FIG. 115 and 116 show a display screen of the touch screen 151 when the user operates the hot key for activating the handwriting input function in the state of FIG. 114 (a).

115 and 116, when the hot key is operated, the control unit 180 recognizes that the screen of the touch screen 151 is divided into the moving picture playback screen 151-41 and the handwriting input area 151-42 have. In the handwriting input area, handwriting input start time information (i.e., moving picture screen capture time information, 151-43) is displayed, and tools for performing a handwriting input function are displayed.

115, the captured moving picture screen is not displayed in the handwriting input area. However, when the user manipulates the save button, the controller 180 outputs data generated based on the captured moving picture screen and handwriting input together It can be saved as a single file. In addition, the controller 180 may generate and store a file containing only the generated data, except for the captured moving picture screen.

116 shows another example of the change of the display screen of the touch screen according to the process of executing the handwriting input function according to the memo file generating method shown in FIG. 115 and 116, in FIG. 116, a moving picture image captured in the background is displayed in the handwriting input area 151 - 42, and a moving picture capturing time 151 - 38 and a handwriting input 151 - And a storage button 151-39 for storing a file created based on the stored information.

FIG. 117 shows an example in which a generation position of a file generated according to the memo file generation method shown in FIG. 113 is provided through a moving image playback screen.

117, the controller 180 displays on the moving picture playback screen, indicators 151-45 and 151-46 indicating that the user has generated and stored a memo file based on the handwriting input function, As shown in FIG. The display point of the indicator may be a time at which the handwriting input function is activated, a time at which the file is created based on the handwriting input function, and the like.

118 is a flowchart showing another example of a memo file generation method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file generation method will be described with reference to necessary drawings.

The hotkey operation for activating the handwriting input function during the execution of the web browser is recognized (S1600). Then, the control unit 180 captures the web browser execution screen, activates the handwriting input function through the touch screen 151 (S1610), continues the update of the web browser execution screen, Is set as the handwriting input means (S1620). Here, the update of the web browser execution screen may include updating the content displayed on the web browser execution screen, updating the article displayed on the web browser execution screen, and the like. However, the scope of the present invention is not limited thereto.

If the handwriting input is received through the touch screen 151 while the touch screen 151 is set as the handwriting input means, the controller 180 generates a file based on the received handwriting input (S1630) , And stores the generated file on the basis of the user's operation (S1640). Here, the generated file includes data generated based on the handwriting input. However, it is optional that an image of the execution screen of the captured web browser is included in the generated file.

118, the mobile terminal 100 according to the present invention can update the execution screen of the running application by reflecting the execution result of the application even when the handwriting input function is activated.

Although not shown in the drawing, the mobile terminal 100 according to the present invention may not change the display state of the content through the touch screen 151, even if the handwriting input function is activated. For example, when the handwriting input function is activated while the flash-based moving image is displayed on the display screen of the touch screen 151, the controller 180 may not change the display state of the flash-based moving image. This is also true when the flash-based content is displayed on the web browser execution screen.

119 is a flowchart showing another example of a memo file editing method in the mobile terminal 100 according to the present invention. Hereinafter, the memo file editing method will be described with reference to necessary drawings.

A file created and stored based on the handwriting input function is displayed on the touch screen 151 (S1700). When the stored file is displayed, the user's hotkey operation is recognized (S1710). Here, the hot key may be a hot key set to activate the handwriting input function.

If the hotkey operation of the user is recognized, the control unit 180 enters the edit mode for the stored file of the mobile terminal 100, and performs file editing based on the operation of the user (S1720). Here, the operation of the user may include deletion of handwriting input, additional handwriting input, and the like. However, the scope of the present invention is not limited thereto.

Then, the control unit 180 stores the edited file based on the user's operation (S1730). Here, the edited file may be stored in a data storage area in which a file has been stored. In addition, the edited file can be stored in a new data storage area. At this time, the controller 180 may display a user interface on the touch screen 151 for selecting or setting a data storage area in which the edited file is to be stored.

Each of the file generation methods, file sharing method, and handwriting input usage methods in the mobile terminal 100 according to the present invention can be implemented in a form of a program that can be executed through various computer means, Lt; / RTI > The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program recorded on the medium may be those specially designed and constructed for the present invention or may be those known to those skilled in the computer software.

Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of programs include high-level language code that can be executed by a computer using an interpreter or the like, as well as machine code as produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

100: mobile terminal 110: wireless communication unit
116: input unit 120: A / V input unit
130: user input unit 140: sensing unit
150: output unit 151: display unit
152: Acoustic output unit 160:
170: interface unit 180: control unit
190:

Claims (24)

touch screen;
An input unit for generating input data; And
Capturing a display screen of the touch screen in response to predetermined input data generated based on an operation on the input unit, generating data corresponding to a handwriting input received through the touch screen, And a control unit for activating a handwriting input function for generating a file including a capture image of a display screen of the touch screen,
Wherein the controller displays on the touch screen a user interface that allows the user to select whether to include the captured image in the file when the handwriting input function is activated. The apparatus of claim 1,
Wherein the handwriting input function is activated in response to a predetermined hotkey operation for a plurality of hardware keys included in the input unit. The apparatus of claim 1,
A handwriting input function based on at least one of a specific gesture of the user recognized based on the image photographed through the camera included in the input unit and a predetermined voice command of the user predetermined through the microphone included in the input unit, And activating the mobile terminal. The apparatus of claim 1,
Wherein the mobile terminal activates the handwriting input function based on a touch of a soft key displayed on the touch screen or a specific type of touch received through the touch screen. delete The apparatus of claim 1,
When the predetermined input data is generated in a state in which the power supplied to the touch screen is cut off, power is supplied to the touch screen, then the handwriting input function is activated, and the file of the captured image of the display screen of the touch screen And displaying the user interface on the touch screen. The apparatus of claim 1,
Displaying on the touch screen a user interface capable of activating the handwriting input function and selecting whether to include the captured image of the lock screen screen in the file when the predetermined input data occurs in a lockscreen state Wherein the mobile terminal is a mobile terminal. delete delete delete delete delete delete The apparatus of claim 1,
Wherein the touch screen displays a user interface for automatically deactivating a hardware key disposed on a front surface of the mobile terminal or deactivating the hardware key when the handwriting input function is activated. The apparatus of claim 1,
Wherein when the handwriting input function is activated and the display screen of the touch screen is captured, specific information corresponding to the display screen of the touch screen is acquired, and the acquired specific information is stored together with the generated file terminal. delete The method according to claim 1,
Wherein the display screen of the touch screen is an execution screen of a specific application. delete 18. The apparatus of claim 17,
When the handwriting input function is activated and the handwriting input is received through the touch screen during execution of a call application of a specific counterpart, data corresponding to the received handwriting input is generated and stored as data corresponding to the specific counterpart . 20. The apparatus of claim 19,
Wherein the stored data is additionally displayed on an execution screen of a call application for the specific counterpart when a call application is executed for the specific counterpart after the generated data is stored. 20. The apparatus of claim 19,
Storing the generated data as specific input data corresponding to the specific counterpart when the generated data is a character recognition result for the handwritten input and the generated data matches the format of the specific input data in the contact application The mobile terminal comprising: 18. The apparatus of claim 17,
When the handwriting input function is activated while a specific unit area of a specific content composed of a plurality of unit areas is displayed on the touch screen and the handwriting input is received through the touch screen, data corresponding to the received handwriting input is generated And stores the data as data corresponding to the specific unit area of the specific content. 18. The apparatus of claim 17,
When the handwriting input function is activated during execution of a calendar application and a handwriting input is received through the touch screen, data corresponding to the handwriting input is generated, and the generated data is displayed on the execution screen of the calendar application And stores the selected date in association with the selected date. 18. The apparatus of claim 17,
Wherein the handwriting input function is activated during execution of a messaging application to generate data corresponding to the received handwriting input when the handwriting input is received through the touch screen and to transmit the generated data to the execution screen of the messaging application And stores the selected mobile communication terminal in association with the selected specific mobile communication terminal.

Images