KR20150070837A - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal capable of enhancing user convenience and a control method thereof. According to one of the embodiments of the present invention, the mobile terminal can detect a tapping input as well as the intensity of the tapping input and identify another party through the detection result while transmitting a predetermined message at the same time, thereby enabling messages to be transmitted and received quickly.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal and a control method thereof, in which usage of a terminal can be realized by further considering the convenience of a user.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In the case of a mobile terminal, a touch screen is often used as an input / output means in order to secure portability of the mobile terminal. This is because the touch screen can perform both functions as a user input unit and an output unit, and can play a large role in providing an intuitive control of the mobile terminal.

The intuitive control method is one of the factors that is very important for the user who uses the mobile terminal. Various types of terminals are being used in human life and there are too many learning processes for users to acquire individual control methods of these terminals.

Therefore, the development of a control method for a mobile terminal is focused on the development of a more intuitive input method for a user.

One example of this intuitive input method is tapping. The tapping input method refers to an input method in which a user shortly strikes one area (i.e., a touch screen) of a mobile terminal a predetermined number of times (at least one time or more). The tapping input method is similar to the knocking operation in daily life. Knock is a pretentious act of tapping the door lightly before entering the room. In other words, the tapping operation can be intuitively understood as an act of notifying a predetermined counterpart who wants to communicate through the mobile terminal or the mobile terminal.

The mobile terminal may be able to sense the tap input through various sensors / methods.

A first method for the mobile terminal to detect the tap input includes detecting tap input through the touch screen. When the touch screen is activated, the touch input of the user input on the touch screen is sensed and the tap input can be sensed through the sensed touch input. The use of this first method has the disadvantage that the tap input can be limited on the touch screen.

A second method for the mobile terminal to sense the tap input is to detect the tap input through the acceleration sensor. When the user makes a tap input in one area of the mobile terminal, the acceleration sensor can detect the acceleration change of the mobile terminal received by the tap input and transmit the detected acceleration change to the controller. The control unit may sense the tapping input through the acceleration change of the mobile terminal. On the other hand, the second method has a disadvantage in that the sensitivity of the tap input may be somewhat lower than that of other input methods.

As a third method for the mobile terminal to detect the tap input, sensing the tap input using the touch screen and the acceleration sensor. If both methods are applied, the mobile terminal will be able to detect the tapping input by complementing the disadvantages caused by each method.

On the other hand, for such an intuitive input method, a detailed control method of the mobile terminal needs to be discussed.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal and a control method thereof that can detect a knock-on input received in a body of a mobile terminal.

It is an object of the present invention to provide a more intuitive mobile terminal and a control method thereof by sensing a knock-on input received in a body of a mobile terminal.

It is an object of the present invention to provide a mobile terminal and a control method thereof that can easily contact a predetermined counterpart in response to a knock-on input received in a body of a mobile terminal .

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to another aspect of the present invention, there is provided a wireless communication system including: a wireless communication unit for communicating with another terminal; touch screen; A sensor unit for sensing a tapping input received on the touch screen; And controls the touch screen to output a predetermined image. When the touch input device receives the tap input received on the predetermined image to be output, it identifies the counterpart terminal corresponding to the predetermined image, and transmits a predetermined message to the counterpart terminal And controlling the wireless communication unit to transmit the wireless communication unit.

The controller may recognize a face of at least one person included in the predetermined image, and the identified counterpart terminal may be a terminal corresponding to the recognized face.

The apparatus may further include a memory unit for storing at least one contact information and face recognition information, wherein the control unit identifies the counterpart terminal based on contact information corresponding to the recognized face among the stored at least one contact information can do.

The control unit may attach data on all or a part of the predetermined image to the predetermined message.

And a memory unit for storing at least one image data, wherein the control unit controls the wireless communication unit to receive a reply message of the transmitted predetermined message, and controls at least one of the at least one And the comment information may be stored in the memory unit together with the predetermined image.

The control unit may control the touch screen to output the comment information corresponding to the predetermined image stored in the memory unit upon receiving a comment display command for the predetermined image from the user via the touch screen .

According to another aspect of the present invention, there is provided an image processing method including: outputting a predetermined image on a touch screen; Identifying a counterpart terminal corresponding to the predetermined image when detecting a tapping input received on the output predetermined image; And controlling the wireless communication unit to transmit the predetermined message to the identified counterpart terminal.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to detect the knock-on input received at the mobile terminal body.

In addition, according to at least one embodiment of the present invention, an intuitive control method of a mobile terminal can be provided through a knock-on input received in a mobile terminal body.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.
3 is a rear perspective view of the portable terminal shown in FIG.
FIG. 4 is a rear perspective view showing a rear surface of a rear case of a mobile terminal according to an embodiment of the present invention. FIG.
5 is a conceptual diagram illustrating a method for controlling a mobile terminal 100 according to an exemplary embodiment of the present invention.
6 is a diagram showing a state diagram for recognizing a face included in an image and displaying a recognized result (face recognition information) together with an image according to an embodiment of the present invention.
FIG. 7 is a conceptual diagram of a control method of transmitting an initial storage message to a predetermined counterpart in response to a hit input received from a user, in a mobile terminal 100 according to an exemplary embodiment of the present invention.
8 is a diagram illustrating an example of the operation of a notification object displayed in response to reception of a status request message according to an embodiment of the present invention.
9 is a diagram illustrating a control method for determining and transmitting one of a plurality of status request messages according to a user's selection according to an embodiment of the present invention.
10 is a diagram illustrating a control method of transmitting a status request message requesting a quick reply, according to an embodiment of the present invention.
11 is a diagram illustrating a control method of detecting a pattern of a tap input and transmitting a status request message corresponding to a detected pattern in the mobile terminal 100 according to an embodiment of the present invention.
12 is a diagram illustrating a method for proposing to transmit a status request message to a plurality of terminals through one input according to an embodiment of the present invention.
13 is a diagram illustrating a control method of transmitting a reply message in response to a received status request message according to another embodiment of the present invention.
14 is a diagram showing a control method of transmitting a message urging confirmation of a text message according to an embodiment of the present invention.
15 is a diagram showing a control method of transmitting additional information together with a message urging confirmation of a text message according to an embodiment of the present invention.
16 is a diagram illustrating a control method of transmitting a confirmation completion message corresponding to a tapping input on a received text message according to an embodiment of the present invention.
17 is a diagram illustrating a control method of transmitting a predetermined message when a tap input is received on a gallery application, according to an embodiment of the present invention.
18 is a diagram showing a control method of confirming a comment created for a predetermined photograph according to an embodiment of the present invention.
19 is a diagram illustrating a control method of identifying a party for transmitting a sharing request message related to a predetermined image, according to an embodiment of the present invention.
20 is a diagram illustrating a control method of transmitting a message in response to a tap input, which is performed on a terminal list capable of short-range communication, according to an embodiment of the present invention.
21 is a diagram illustrating a control method of transmitting a message requesting state sharing according to an embodiment of the present invention.
22 is a diagram illustrating a control method by which a mobile terminal transmits a connection establishment request message in response to a tap input according to an embodiment of the present invention.
23 and 24 are diagrams showing a control method of determining a recipient party of a message when a plurality of persons included in a predetermined image are plural according to an embodiment of the present invention.
25 is a flowchart illustrating a control method of identifying a counterpart corresponding to a hit input received on a predetermined image and transmitting a predetermined message to the counterpart party, according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may comprise at least one of a base station, an external terminal, and a server on a mobile communication network such as Global System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112).

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the position information module 115 calculates distance information and accurate time information from three or more satellites, and then applies a trigonometric method to the calculated information to obtain three-dimensional (3D) information according to latitude, longitude, The current position information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 and a touch sensor (static pressure / static electricity) 137 located on the front and rear sides or side surfaces of the mobile terminal 100, and may include a keypad, A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 include a gyroscope sensor, an acceleration sensor, and a geomagnetic sensor.

For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 generates an output related to the visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, an LED (light emitting diode) unit 603 And a haptic module 154 may be included.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the sound output module 152 may be a type of the alarm unit 153. The display unit 151 and the sound output module 152 may be connected to the display unit 151 or the sound output module 152, .

The LED unit 603 can output a visual output having various colors by using LED elements based on a control signal from the control unit 180. [

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact of an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, still image, For example. The memory 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the mobile terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted And may be a passage to be transmitted to the terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of the interface unit 170 in which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Hereinafter, the display unit 151 will be described on the assumption that the touch screen 151 is used to describe the embodiment of the present invention. However, the embodiments of the present invention are not limited to the touch screen 151.

In addition, in the embodiment of the present invention, the touch gesture refers to a gesture realized by touching or touching the touch screen 151 in a touch manner, and the touch input means an input received by the touch gesture.

The touch gesture may be tapping, touching and dragging, flicking, press, multi-touch, pinch-in, pinch-out, .

Tapping refers to a touch gesture such as a click of a mouse on a general personal computer, which is an operation of lightly pressing and releasing the touch screen 151 once.

In addition, the touch drag may be an operation of moving to a specific position while keeping the touch on the touch screen 151, and when the object is dragged, the object may be continuously displayed according to the drag direction.

In addition, flicking refers to an operation of touching the touch screen 151 and then moving the contact in a specific direction (upward, downward, left, right or diagonal) and then releasing the contact point. The mobile terminal 100, The processing of the specific operation is performed based on the flicking direction, speed, and the like. For example, the page turning operation of the e-book can be performed based on the flicking direction.

In addition, the press refers to an operation of continuously holding the touch for a predetermined time or longer after touching the touch screen 151. [

In addition, the multi-touch means an operation of touching a plurality of points of the touch screen 151 at the same time.

In addition, the pinch-in refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers that are multi-touching approach each other. That is, a drag that starts from at least one point among a plurality of points that are multi-touched on the touch screen 151 and occurs in a direction in which a plurality of points that are multi-touched approach each other.

In addition, the pinch-out refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers in a multitouch direction move away from each other. That is, dragging starts from at least one point among a plurality of points that are multi-touched in the touch screen 151 and occurs in a direction in which a plurality of points that are multi-touched move away from each other.

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

In some cases, electronic components may be mounted on the surface of the rear case 102 as well. Electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, a memory card, and the like which are detachable by the user. At this time, the rear case 102 may further include a rear cover 103 for covering the surface thereof. When the rear cover 103 is removed, the surface of the rear case 102 is exposed.

As shown in FIG. 2, when the rear cover 103 is coupled, only a part of the side surface of the rear case 102 may be exposed. When the size of the rear cover 103 is reduced, Some may also be exposed. And an opening 103 'for exposing the camera 121' or the sound output unit 152 'to the outside when the rear cover 103 covers the entire rear surface of the rear case 102.

The cases 101, 102 and 103 may be formed by injection molding of synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output module 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface unit 170, and the like may be disposed in the terminal cases 101 and 102 .

The display unit 151 occupies most of the main surface of the front case 101. A sound output module 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface unit 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as the adjustment of the sound output from the sound output module 152 And the third operation unit 133 can receive a command such as switching to the touch recognition mode of the display unit 151 or the like.

3 is a rear perspective view of the portable terminal shown in FIG.

Referring to FIG. 3, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

FIG. 4 is a rear perspective view showing a rear surface of a rear case of a mobile terminal according to an embodiment of the present invention. FIG. 4, the front case 101, the rear case 102, the rear cover (or the battery cover) 103, the camera 121 ', the interface unit 170, the microphone 122, A battery 191, a battery mounting portion 104, a USIM card mounting portion 166, and a memory card mounting portion 167 are shown.

The rear case 102 may have a space on which external components such as the battery loading unit 104, the USIM card loading unit 105, and the memory card loading unit 106 may be mounted. In general, an external component mounted on the surface of the rear case 102 is used to extend the functions of the mobile terminal 100 in order to satisfy diversified functions of the mobile terminal 100 to be.

As the performance of the mobile terminal 100 is diversified, a battery 191 may be replaced with a battery 191 as shown in FIG. 4 to compensate for a large power consumption. In the case of the interchangeable type, a battery mounting portion 104 is formed on the surface of the rear case 102 so that a user can attach and detach the battery. The battery mounting portion 104 is provided with a connection terminal to be electrically connected to a component mounted inside the case.

4, the USIM card mounting portion 166 and the memory card mounting portion 167 may be formed on the side of the battery mounting portion 104 or on the bottom surface of the battery mounting portion 104, May be formed to be exposed to the outside. In this case, the size of the battery mounting portion 104 can be larger, and the size of the battery 191 can be increased.

4 shows a structure in which the USIM card mounting portion 166 and the memory card mounting portion 167 are mounted on the rear surface of the rear case 102. In addition, Do.

The rear cover 103 covers the surface of the rear case 103 to secure the battery 191, the USIM card, the memory card, and the like mounted on the rear case 102 so as not to be detached from the rear case 102, Thereby protecting the external component. A waterproof structure (not shown) for sealing the rear case 102 and the rear cover 103 when the rear case 102 and the rear cover 103 are coupled to each other to prevent water from being injected into the external components.

As described above, it is assumed that the mobile terminal 100 according to an embodiment of the present invention not only can sense a user's tap input, but also can detect the strength of the tap input.

According to the first method for sensing the tap input, the mobile terminal 100 can sense the tap input through sensing the touch input of the user through the touch screen 151. [ For example, when the duration of the touch input is shorter than a predetermined time (for example, 0.1 second), the controller 180 determines that the touch input input through the touch screen 151 is a tap input . This is because, in the case of the tapping input, the touch input must be received and released within a short time.

If the tapping input is defined as tapping input two or more times, if the touch input is input a predetermined number of times during a predetermined time interval, the controller 180 may determine that the tapping input has been received.

In addition, the controller 180 according to the first method can determine the touch area of the touch input of the user received through the touch screen 151 and determine the strength of the tap input in proportion to the width of the touch area . If the user inputs a tap input having a relatively weak intensity, a touch area having a smaller area than the tap input having a strong intensity can not be obtained. This is because the area of the finger touching the touch screen 151 increases as more pressure is applied to the finger performing the touch.

Meanwhile, the controller 180 according to the second method for detecting the tap input receives the tap input by detecting the acceleration change of the mobile terminal according to the tap input of the user, detects the intensity of the acceleration change, . ≪ / RTI >

Finally, even in the case of the third method of combining both the touch screen of the first method and the acceleration sensor of the second method, in order to detect the intensity of the tap input, the intensity detection method in the first method and the second method . ≪ / RTI >

Meanwhile, in a state in which the touch screen 151 is activated, it is necessary that the tapping input 601 input on the touch screen 151 is clearly distinguished from a general touch input. The first method for distinguishing the tap input 601 from the general touch input according to an embodiment of the present invention is different from the general touch input according to the intensity of the input. That is, when the touch input is input with a magnitude greater than a predetermined reference magnitude, the mobile terminal 100 recognizes the input as a general touch input. When the magnitude of the touch input is less than a predetermined reference magnitude, .

According to an embodiment of the present invention, the second method for distinguishing the tap input 601 from the general touch input is classified according to the duration of the touch input. That is, when the touch input is input for a time longer than a predetermined reference time, the mobile terminal 100 recognizes the touch input as a general touch input, and when the touch input is input for a time shorter than a predetermined reference time, .

A third method for distinguishing the tap input 601 from the general touch input according to an embodiment of the present invention is classified according to whether or not there is continuous touch input. That is, when the touch input is input once for a predetermined reference interval, the mobile terminal 100 recognizes the touch input as a general touch input, and when the touch input is input more than twice during a predetermined reference interval, Can be recognized.

In the following description of the present invention, it is assumed that the intensity of the knocking input can be sensed through at least one of the above-described methods.

5 is a conceptual diagram illustrating a method for controlling a mobile terminal 100 according to an exemplary embodiment of the present invention.

In an embodiment of the present invention, an intuitive operation of the tap input 501 will be proposed. As described above, the knocking input 501 is used as a knocking operation in daily life, and interpreted as an operation informing someone of the existence of the knocking operation in a dictionary meaning. Accordingly, the mobile terminal 100 according to an embodiment of the present invention can be configured to transmit a message informing a predetermined other party of the presence of the user or a contact availability of the other party (when the user inputs a call or a text message now (Hereinafter referred to as a status request message). 5, the A terminal 100A according to the embodiment of the present invention transmits a status request message to the B terminal 100B when receiving the tap input 501 from the user The wireless communication unit 110 can be controlled.

The transmission of a message according to an exemplary embodiment of the present invention may differ from transmission and reception of a general text message in the following respects. First, according to an embodiment of the present invention, it is possible to transmit through a simple and intuitive input rather than sending and receiving a general text message.

Second, it is easy to identify the recipient. There are various kinds of objects that are output through the touch screen. An embodiment of the present invention can be applied as long as a predetermined counterpart (terminal of a predetermined counterpart) can be specified by various kinds of objects outputted in this manner. That is, when a tapping input is received on the object, the message can be transmitted by specifying the corresponding counterpart terminal.

Third, it uses pre-stored text messages. Therefore, in transmitting a message to the other party, it is not required to input a character separately. Furthermore, an embodiment of the present invention further proposes a method of distinguishing a sender's simple intention (intention to send a message) and the like. It is also possible to transmit the message transmission intention of the sender by selecting any one of the previously stored text messages according to the tapping operation pattern or the user's selection input received after the tapping operation.

In an embodiment of the present invention described below, a method of identifying a party (specifically, a counterpart terminal) to which a terminal A 100A transmits a predetermined message, corresponding to a tap input received from a user, A method in which the B terminal 100B displays a message in which a message is received, a method in which the B terminal 100B replies a message, and a reply in the B terminal 100B is received A terminal 100A will now be described in detail.

In order to describe the embodiments of the present invention, the A terminal 100A and the B terminal 100B are typically represented, and the components of each terminal are distinguished using A and B, respectively. That is, in expressing the control unit 180 among the configuration of the mobile terminal 100, the control unit of the A terminal 100A is indicated by the A control unit 180A and the control unit of the B terminal 100B is controlled by the B control unit 180B .

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as above will be described with reference to the accompanying drawings.

Hereinafter, the face recognition and the face recognition information in the image will be described with reference to FIG.

In the drawings for explaining one embodiment of the present invention to be described below, the case of the appearance of the mobile terminal 100 is omitted for the sake of clarity of the drawings, and a case where a screen displayed on the touch screen 151 of the mobile terminal 100 Only the state diagram of FIG.

6 is a diagram showing a state diagram for recognizing a face included in an image and displaying a recognized result (face recognition information) together with an image according to an embodiment of the present invention.

6 (a) shows a state diagram for viewing an image in general, and three persons are included in the displayed image. The controller 180 according to an embodiment of the present invention can recognize a face for each of the characters included in the image through an algorithm capable of analyzing the face on the image. The algorithm may analyze the eye, nose, or mouth of a person in the image and recognize the face of the person using the analyzed eye, nose, or mouth. Hereinafter, in a detailed description for explaining an embodiment of the present invention, a result recognized through the algorithm will be referred to as face recognition information. The face recognition information may include the relative position information of the face recognized on the entire area where the image is output. If there are a plurality of characters appearing on the photograph, the face recognition information may be individual information for each of at least one person among a plurality of persons. Accordingly, when a plurality of persons are included in the image, the face recognition information of the image may include a face recognition result for at least one of the plurality of persons.

6 (b) shows a state diagram in which a recognized face is displayed so as to be distinguished, according to an embodiment of the present invention. The control unit 180 can output facial indicators 601-1 to 601-3 to the recognized face on the photograph being output. That is, the controller 180 may display the face indicators 601-1 to 601-3 together with the output of the photograph based on the face position information included in the analyzed face recognition information.

Furthermore, the algorithm can distinguish between the recognized faces, whether they are the same person or another, by analyzing different eye, nose, or mouth features for each person. That is, the control unit 180 can determine whether the face is the same face by comparing it with the pictures stored in the contact through the face recognized from the photograph. Accordingly, when it is determined that the face is the same as the face stored in the contact as a result of recognizing the face, the controller 180 can further display the additional information stored in the contact of the person.

That is, the control unit 180 analyzes the face in the image, identifies the face, and matches the face with specific contact information. The matched contact information may be additionally displayed on the image.

As an example of the additional information, the control unit 180 in the example of FIG. 6C may output the name tags 602-1 to 602-3 for the recognized face person as additional information together with the photograph.

7 is a conceptual diagram of a control method of transmitting an initial storage message to a predetermined counterpart in response to a hit input received from a user in the mobile terminal 100 according to an embodiment of the present invention

As shown in Fig. 7A, the control unit 180A outputs at least one object through the A touch screen 151A. Referring to FIG. 7A, the A touch screen 151A of the A terminal 100A displays the contact list in the execution state of the telephone transmission / reception application, and outputs at least one contact object on the contact list. 7A, when the tap input 501-1 is received on the contact object "team leader ", the A control unit 180A identifies the correspondent terminal corresponding to the contact object" team leader " . Specifically, the A control unit 180A can identify the phone number or other terminal identification information of the correspondent terminal corresponding to the contact object "Team Manager" Then, the A control unit 180A can control the A wireless communication unit 110A to transmit the first status request message to the identified counterpart terminal 100B.

The status request message is a message transmitted in response to a tap input, and may be a pre-stored message. Also, a specific message among a plurality of pre-stored messages may be selected, and the selected message may be transmitted. The process of selecting a predetermined message from among the previously stored message and the plurality of messages will be described below with reference to FIGS. 9 to 11. FIG. In the embodiment illustrated in FIG. 7, it is assumed that there is one pre-stored message.

The first status request message may include identification information of the transmitter A terminal 100A. The identification information of the transmitting side A terminal 100A may be a contact. Hereinafter, the status request message to be described later may similarly include the identification information of the transmitting terminal A 100A.

Referring again to FIG. 7B, the B terminal 100B displays a lock screen through the B touch screen 151B. The B terminal 100B having received the first status request message from the A terminal 100A indicates that it has received the first status request message through the B touch screen 151B as shown in FIG. The first notification object 700 can be displayed.

In the example shown in FIG. 7 (c), the first notification object 700 may be displayed directly on the lock screen, and may include any one of the photographs of the other party that has sent the message, . Meanwhile, the form of the notification object is not limited to the first notification object 700, but can be applied to embodiments of the present invention as long as it is an object that can inform the user in any form.

The B control unit 180B receives at least one reply option icon 701a (hereinafter, referred to as " B ") when receiving the input 501-2 from which the first notification object 700 is selected from the user of the B terminal 100B To 701c can be displayed on the B touch screen 151B. Subsequently, when receiving the input 501-3 from which the option icon of any one of the at least one reply option icons 701a to 701c is selected, the B control unit 180B transmits the second status request message to the A terminal The B wireless communication unit 110B can control the B wireless communication unit 110B to return to the B wireless communication unit 100A.

On the other hand, in the example shown in Fig. 7 (d), it is assumed that the option icon includes a call origination option icon 701b and the call origination option icon 701b is selected by the B user. The telephone call option icon 701b is an option for calling and returning to the A terminal 100A that has transmitted the first status request message and the B control unit 180B responds accordingly to the A terminal 100A (Refer to FIG. 7 (d) and (e)).

The A terminal 100A that has received the call signal from the B terminal 100B can output a popup window 702 informing that the call signal is being received (see Fig. 7 (e)).

In FIG. 7, the B terminal 100B having received the first status request message controls the first notification object 700 to be displayed through the B touch screen 151B. Hereinafter, additional operations of the first notification object 700 will be described with reference to FIG.

8 is a diagram illustrating an example of the operation of a notification object displayed in response to reception of a status request message according to an embodiment of the present invention.

In FIG. 8A, the B terminal 100B displays the first notification object 700 in response to receipt of the status request message. In one embodiment of the present invention, it is proposed that the first alarm object 700 gradually decreases with time (see Figs. 8 (b) and (c)).

The reason for this is that an embodiment of the present invention described with reference to FIG. 8 is configured to request a reply to a state at the time of transmitting a status request message to a counterpart (user B) Request message. Therefore, if the B user 100B can not immediately respond, the desired time of the sender lapses. Accordingly, the B control unit 180B controls the size of the alarm object to be gradually reduced, and controls to stop the display of the alarm object when the size becomes smaller than a predetermined size (after a predetermined time).

In the embodiment of the present invention described with reference to Figs. 6 to 8, a message asking about the state of a simple receiving party is transmitted. Further, in another embodiment of the present invention to be described below with reference to FIG. 9 to FIG. 11, it is proposed to transmit a message suggesting a specific action to the receiving party. That is, in the above-described embodiment, if the type of the status request message to be transmitted does not vary, it is proposed that the embodiment will vary in the following embodiments. Accordingly, the mobile terminal 100 according to an exemplary embodiment of the present invention proposes to store a plurality of status request messages, and then determine and transmit one status request message according to a user's input pattern or selection. Hereinafter, a detailed description will be given with reference to the drawings.

9 is a diagram illustrating a control method for determining and transmitting one of a plurality of status request messages according to a user's selection according to an embodiment of the present invention.

Referring to FIG. 9A, at least one contact object is displayed on the A touch screen 151A, and a tapping input (not shown) is made on the "team leader" contact object via the A touch screen 151A, 501-1) is received.

The A control unit 180A can display at least one theme object 901a to 901c corresponding to the tapping input 501-1, unlike in Fig. When the user A selects (10a) any one of the displayed at least one theme objects 901a to 901c, it proposes to transmit a second status request message based on the selected theme object. That is, the A-terminal 100A stores a plurality of status request messages corresponding to the themes, determines a status request message corresponding to the theme selected by the selection of the theme objects among the stored status request messages, .

The theme in the theme object may include at least one of a movie, a coffee, a meal, and a walk. In the example shown in Fig. 9 (b), a third theme object 901c suggesting coffee among the first to third theme objects 901a to 901c is selected. The A control unit 180A can control the A wireless communication unit 110A to transmit the second status request message corresponding to the selected third theme object 901c. The user A can ask the user B through the second status request message whether he or she is able to drink the selected option coffee. Accordingly, the user A can transmit his / her intention to the user B with only a simple operation.

The B control unit 180B of the B terminal 100B having received the second status request message can convey the intention of the A user by displaying the third theme object 901c together with the first notification object 700 See Fig. 9 (d)). In the example shown in Fig. 9 (d), the third suggested option icon 901c is shown with an icon drawn coffee.

In the embodiment described above with reference to FIG. 9, it is proposed to transmit a user's intention to transmit through a plurality of theme selection. Hereinafter, FIG. 10 proposes a control method capable of conveying the urgency / urgency of the user.

10 is a diagram illustrating a control method of transmitting a status request message requesting a quick reply, according to an embodiment of the present invention.

According to the above-described embodiment of the present invention, the user A transmits a message requesting a predetermined reply to the user B. However, if the B user is not responding or is in an urgent situation and needs a fast reply, the A user will want to send a message prompting him / her to reply. In an embodiment of the present invention, it is proposed that a large number of tap input is inputted as an input for transmitting a message prompting reply. That is, when the A terminal 100A receives a tap input (hereinafter referred to as multiple tap input) over a predetermined number of times within a predetermined time interval from the A user, a status request message (hereinafter referred to as a third status request message) To the B terminal 100B.

As shown in Fig. 10A, the A terminal 100A displays at least one contact object. When the multi knock input 1001 is received on the contact object "Team Leader ", the A control unit 180A, Lt; / RTI > may send a third status request message to the B terminal 100B.

The B terminal 100B having received the third status request message which is a message requesting the quick reply can display the first notification object 700 and display the highlight indicator 1002 to indicate that a quick reply is requested You can display more.

Hereinafter, in FIG. 11, it is further proposed to detect a pattern of a user's tap input and determine a status request message according to a tap input pattern.

11 is a diagram illustrating a control method of detecting a pattern of a tap input and transmitting a status request message corresponding to a detected pattern in the mobile terminal 100 according to an embodiment of the present invention.

The tapping pattern may include at least one of the number of tapping inputs, the intensity of the tapping input, the time interval between the tapping input when a plurality of tapping inputs are received, and the direction of the touch input received after the tapping input. However, the embodiment of the present invention is not limited to the kind of the beat pattern.

Referring to FIG. 11A, the A terminal 100A displays at least one contact object, and receives a tapping input 1101-1 of the first pattern on the 'team leader' contact object. Upon receipt of the beat input 1101-1 of the first pattern, the A control unit 180A transmits a fourth state request message corresponding to the beat input 1101-1 of the first pattern among the plurality of state request messages stored previously And transmit the determined fourth status request message to the B terminal 100B.

11A, the status request message corresponding to the tapping input 1101-1 of the first pattern is a status request message corresponding to the coffee theme, the tapping input 1101-2 of the second pattern, The status request message corresponding to the movie theme is assumed to be a status request message corresponding to the movie theme.

The B terminal 100B receiving the fourth status request message can display the third theme object 901c corresponding to the fourth status request message (see FIG. 11 (b)). On the other hand, the B terminal 100B receiving the fifth status request message corresponding to the tapping input 1101-2 of the second pattern can display the first theme object 901a corresponding to the fifth status request message (See Figs. 11 (c) and 11 (d)).

Further, in one embodiment of the present invention, it is proposed to transmit a status request message to a plurality of terminals through one input. This embodiment will be described with reference to Fig.

12 is a diagram illustrating a method for proposing to transmit a status request message to a plurality of terminals through one input according to an embodiment of the present invention.

12A, the terminal A 100A displays at least one contact object, and inputs tapping inputs (501-4 and 501-5) to each of the 'contact' object and the 'contact' . That is, when receiving a beat input on a plurality of objects, the A control unit 180A can determine a plurality of counterparts corresponding to each object and transmit a status request message to each of the determined counterparts. The tapping input on the plurality of objects may be input by the user using the plurality of fingers.

In the example shown in Fig. 12A, the A control unit 180A receiving the tap input 501-4 and 501-5 receives the B terminal 100B and the C terminal 100C corresponding to the respective contact objects . Then, the A control unit 180A can transmit a status request message to each of the determined B terminal 100B and C terminal 100C.

As shown in FIGS. 12B and 12C, each of the B terminal 100B and the C terminal 100C, which have received the status request message, can display the first notification object 700.

In the above-described embodiment, a control method of transmitting a status request message has been described. In the embodiment to be described below, a control method in which a terminal receiving a status request message transmits a reply message in response to a received status request message will be described.

13 is a diagram illustrating a control method of transmitting a reply message in response to a received status request message according to another embodiment of the present invention.

13A and 13C, the B terminal 100B has received a status request message from the A terminal 100A and has received the first notification object 700 according to an embodiment of the present invention. Is displayed on the B touch screen 151B.

In a terminal receiving a status request message according to an embodiment of the present invention, when a hit input is received from a user, a reply message including additional information according to the number of fingers to be input is generated and transmitted.

As shown in Figs. 13A and 13B, the B control unit 180B receives the tap input (hereinafter referred to as the first tap input 1301-1) using the first number of fingers, It is possible to transmit the first reply message including the first reply message. The first additional information may include time information. In the example shown in Fig. 13 (b), the first additional information together with the time information indicating the state in which the user B can not be contacted at the same time while taking the time to the state where the user can be contacted at the same time is also included.

Upon receiving the first reply message, the A terminal 100A can display a pop-up window 1302 for displaying the contents of the first reply message.

In the example of FIGS. 13 (a) and 13 (b), the tapping first multi tap input using two fingers may indicate that the time taken until the user is ready to contact is about two hours. Therefore, the popup window 1302 can display information that the reply party in Fig. 13 (b) can talk after two hours.

Subsequently, as shown in Figs. 13C and 13D, when the tapping input (second tapping input, 1301-2) is received using the second number of fingers, the B control unit 180B receives the second additional information The second reply message including the second reply message can be transmitted. Upon receiving the second reply message, the A terminal 100A can display a pop-up window 1302 for displaying the contents of the second reply message.

In the example of Figs. 13 (c) and 13 (d), the tapping second multi tap input using three fingers may indicate that the time taken until the user is ready for contact is about three hours. Therefore, the popup window 1302 in Fig. 13D can display information that the reply party can talk after three hours.

Further, in an embodiment of the present invention, it is proposed to further transmit a message prompting the other party to confirm the text message. This embodiment will be described with reference to Figs. 14 and 15. Fig.

14 is a diagram showing a control method of transmitting a message urging confirmation of a text message according to an embodiment of the present invention.

In Fig. 14A, the A terminal 100A displays at least one object through the A touch screen 151A. Specifically, at least one object may be a send text message object 1401. When the tap input 501-6 is received on the transmission text message object 1401, the A control unit 180A identifies the counterpart terminal (B terminal) corresponding to the transmission text message object 1401, The confirmation prompt message can be further transmitted to the terminal 100B (see Fig. 14 (b)). The identified counterpart means the recipient of the transmission of the transmission text message.

The B terminal 100B that has received the confirmation prompt message may further display a popup window 1402 indicating that the confirmation prompt message has been received via the B touch screen 151B as shown in Fig. 14 (b) . The B terminal 100B can control to transmit a confirmation completion message indicating that the confirmation prompt message is confirmed when the tap input 501-7 is received from the user B on the popup window 1402 c) and (d). The A terminal 100A having received the confirmation completion message from the B terminal 100B may further display a popup window 1403 indicating that the confirmation completion message has been received as shown in Fig. 14 (d).

On the other hand, a control method of specifying a theme in addition to the confirmation prompt message will be described with reference to Fig.

15 is a diagram showing a control method of transmitting additional information together with a message urging confirmation of a text message according to an embodiment of the present invention.

Referring to FIG. 15A, at least one object is displayed through the A touch screen 151A. Specifically, at least one object may be a send text message object 1401. A control unit 180A can transmit an acknowledgment message including a theme corresponding to a predetermined phrase when a tapping input 501-8 is received on a predetermined phrase included in a transmission text message object 1401 .

For example, when the knocking input 501-8 is received in the phrase "Coffee" contained in the transmission text message object 1401, the A control unit 180A transmits the coffee theme information together with the confirmation prompt message can do. Upon receiving the coffee theme information together with the confirmation prompt message, the B terminal 100B can display the third theme object 901c representing the coffee theme together with the first notification object 700. [

Referring to FIG. 15C, a transmission text message object 1401 is displayed through the A touch screen 151A. In the example shown in Fig. 15 (c), the tapping input 501-9 is received in the phrase "Movie" included in the transmission text message object 1401. [ When the tap input 501-9 is received, the A control unit 180A can transmit the movie theme information together with the confirmation prompt message. The B terminal 100B receiving the movie theme information together with the confirmation prompt message can display the first theme object 901a representing the movie theme together with the first notification object 700. [

The above-described embodiment is a control method of transmitting an acknowledgment message when a tap input is received on a transmitted text message object. Hereinafter, a control method of transmitting a confirmation completion message when receiving a tap input on a received text message object will be described.

16 is a diagram illustrating a control method of transmitting a confirmation completion message corresponding to a tapping input on a received text message according to an embodiment of the present invention.

16A, the terminal A 100A shows a state of execution of the character transmission / reception application through the A touch screen 151A, and at least one reception text message object 1601 is displayed in the execution state diagram .

The A control unit 180A identifies the counterpart corresponding to the received text message object 1601 when the hit input 501-10 is received on the received text message object 1601 and outputs a confirmation completion message to the identified counterpart Can be transmitted. The identified counterpart may be the sending party of the received text message object 1601.

The B terminal 100B having received the confirmation completion message can display a popup window 1602 on the B touch screen 151B including a notification that the user A has confirmed the text message.

The present invention further proposes an embodiment in which the tap input is made on a photo viewing screen in a gallery application. These embodiments will be described below with reference to FIGS. 17 to 20. FIG.

17 is a diagram illustrating a control method of identifying a counterpart corresponding to a hit input received on a predetermined image and transmitting a predetermined message to the counterpart party identified according to an embodiment of the present invention.

Referring to FIG. 17A, the user A views the first image 1701 through the photo viewing application of the A terminal 100A. When receiving the tapping input 501-11 on the first image 1701 viewing screen, the A control unit 180A identifies the counterpart (B user) corresponding to the first image 1701. [ The A control unit 180A can transmit a sharing request message to the identified other party. The sharing request message may mean, for the first image 1701, that the A user wants to share the viewing of the image to the B user.

In the example shown in Fig. 17, the identified user recognizes at least one character face on the first image 1701 through a face recognition algorithm, and is a counterpart to the recognized face.

Upon receiving the sharing request message, the terminal B 100B can further display the image sharing object 1702 through the B touch screen 151B. The image sharing object 1702 may include an indication of all or part of the first image 1701 displayed on the A terminal 100A (see FIG. 17B).

Upon receiving the image sharing object 1702, the B control unit 180B can display a comment creation popup window 1703 for receiving a comment from the user according to the user's selection. For example, when an input for touching the shared object 1702 is received, the B control unit 180B transmits a comment creation popup window 1703 for receiving a comment to the first image 1701 to the B touch screen 151B Can be displayed.

When the confirmation button is pressed after the comment is created through the displayed comment creation popup window 1703, the B control unit 180B can transmit the comment creation message including the created comment to the A terminal 100A.

Upon receiving the comment creation message, the A terminal 100A can control the A touch screen 151A to display a popup window 1704 displaying the created comment.

18 is a diagram showing a control method of confirming a comment created for a predetermined photograph according to an embodiment of the present invention. In FIG. 18, it is assumed that a comment creation message as in the terminal A of FIG. 17 is received.

Referring to FIG. 18A, the user A browses the image 1701 as shown in FIG. 17 through the photo viewing application of the A terminal 100A. Upon receiving a predetermined input to the image 1701 while browsing the image 1701, a popup window 1801 for displaying a comment created in relation to the image 1701 can be displayed. The pop-up window 1801 may include the plurality of comments when there are a plurality of comments created in association with the image 1701. [

In the embodiment described above with reference to FIG. 17, the face recognition algorithm is applied to a predetermined image in order to identify the transmission destination of the message, but the present invention is not limited thereto. Other examples will be described with reference to Fig.

19 is a diagram illustrating a control method of identifying a party for transmitting a sharing request message related to a predetermined image, according to an embodiment of the present invention.

Referring to FIG. 19 (A), the user A views the second image 1900 through the photo viewing application of the A terminal 100A. When receiving the beat input 501-12 on the second image 1900, the A control unit 180A can display a counterpart identification pop-up window 1901 for identifying a predetermined counterpart. The pop-up window 1901 in the embodiment related to Fig. 19 is a pop-up window for selecting a message transmission destination from a user. In this pop-up window, a face recognition algorithm is not appropriately performed on a predetermined image, It may be displayed when the other party does not exist.

When at least one partner is selected through the partner identification pop-up window 1901, the A control unit 180A will be able to transmit the sharing request message in Fig. 18 to the identified partner terminal.

The messages transmitted in response to the tap input may also be applied using short range communication. A suitable embodiment for using short-range communication will be described with reference to Fig.

20 is a diagram illustrating a control method of transmitting a message in response to a tap input, which is performed on a terminal list capable of short-range communication, according to an embodiment of the present invention.

Referring to FIG. 20 (a), there is shown an execution state diagram of a near field control application for performing near field communication using a predetermined short distance communication method. In the example shown in Fig. 20 (a), the state diagram of the near field control application indicates that no local communication terminal is currently connected.

The A terminal 100A having received the predetermined input for establishing the short-range communication connection can display the terminal list in which the connected record exists. When the tap input 501-13 is received on the object corresponding to the B terminal 100B in the terminal list, the A control unit 180A can transmit the paging message to the B terminal 100B. The paging message is a message for informing the location of the terminal to the user, and the terminal receiving the paging message can notify the user of its location by outputting a predetermined notification signal. For example, the B terminal 100B receiving the paging message controls the sound output module 152 to output a beep sound (see Fig. 20 (c)).

According to the above-described embodiment, a user who wishes to establish a short-range communication between two terminals can easily identify the remaining terminals through a tapping input on any one of the two terminals. This is because, if the terminals to be connected are simply provided as a list, it is difficult to specify which terminal is connected.

21 is a diagram illustrating a control method of transmitting a message requesting state sharing according to an embodiment of the present invention.

21A, the terminal A 100A displays at least one contact object as a thumbnail view through the A touch screen 151A and receives a tap input 501-14 on a predetermined contact object do.

The A control unit 180A having received the beat input 501-14 transmits a state sharing request message to the B terminal 100B. Upon receiving the status sharing request message, the terminal B 100B displays a pop-up window 2002 asking whether to share the status. Upon receiving the input from the user B, the terminal A 100B transmits a reply message to the terminal A .

The B terminal 100B according to the embodiment of the present invention can further transmit the current location information of the B terminal 100B together with the reply message. A terminal 100A can display the current position information of the received B terminal 100B together with a map (see Fig. 21 (d)).

The B terminal 100B according to an embodiment of the present invention can transmit image data (may be real time) received via the B camera 121B of the B terminal 100B at the same time as the reply message. The A terminal 100A having received the image data can display the image data received through the A touch screen 151A. If the image data is real-time, the A terminal 100A can display the image data in the video call format. In the case of the video call format, the B terminal 100B may send voice data to be received through the B microphone 122B together with the reply message, thereby adding and receiving voice signals.

Meanwhile, in an embodiment of the present invention, it is proposed to transmit a message requesting connection establishment through a predetermined application in response to a tap input. This embodiment will be described with reference to FIG.

22 is a diagram illustrating a control method by which a mobile terminal transmits a connection establishment request message in response to a tap input according to an embodiment of the present invention.

Referring to FIG. 22A, the A touch screen 151A of the A terminal 100A displays a contact list in the execution state of the telephone transmission / reception application, and outputs at least one contact object on the contact list. As shown in Fig. 22 (a), when the knock input 501-15 is received on the contact object "team leader ", the A control unit 180A can identify the corresponding member of the contact object" have. Then, the A control unit 180A can control the A wireless communication unit 110A to transmit the sixth status message to the identified counterpart terminal 100B.

Referring to FIG. 22 (b), the B terminal 100B displays a lock screen through the B touch screen 151B. The B terminal 100B having received the sixth status request message from the A terminal 100A indicates that it has received the sixth status request message through the B touch screen 151B as shown in FIG. The first notification object 700 can be displayed. The B control unit 180B may display at least one reply option icon 701a, 701b and 701d together with the first notification object 700 on the B touch screen 151B.

The fourth reply option icon 701d among the plurality of reply reply icons displayed corresponds to an option for requesting connection establishment using a predetermined application.

The predetermined application refers to an application capable of maintaining a connection state between a plurality of terminals using the wireless communication unit 110 and capable of transmitting predetermined user input data while the connection state is maintained. In addition, the predetermined user input data may include handwritten data based on handwriting input by the user, as well as text data input by a user.

The B terminal 100B receives a request from the B user for selecting the fourth reply option icon 701d and returns a message to the A terminal 100A to request establishment of connection using the predetermined application . The A terminal 100A and the B terminal 100B having established the connection can display the execution state diagram of the predetermined application after establishing the connection using the predetermined application (Fig. 22 (d) and (e) Reference).

In the embodiment of the present invention described above with reference to FIG. 17, an image transmission control method of recognizing a face included in a predetermined image and making the recognized face as a receiving side has been described. In the example of FIG. 17, only one person is included in the image. However, when the number of persons included in the image is plural, it may be unclear to whom. 23 and 24 illustrate an embodiment of the present invention according to an embodiment of the present invention. In the case of a plurality of persons included in a predetermined image, And a control method for determining a recipient of a message.

In Fig. 23, the user is suggested to select the receiving side.

23, it is assumed that the third image 2300 is displayed and the third image 2300 includes two persons. The control unit 180A can perform face recognition on two persons. In the example, it is assumed that two persons, "An Eun-hee" and "Seo Young Jeong" are recognized on the third image 2300. [

When an input 501-17 knocked on the third image 2300 is received, the control unit 180A may display a counterpart selection window 2301 for requesting the user to make a selection. The opponent selection window 2301 may include a list of opponents including two characters "Ahn Eun-hee" and "Seo Young Jeong" recognized in the third image 2300. Upon receiving the input 10b for selecting one person, the control unit 180A can transmit a predetermined message to the counterpart terminal (B terminal, 100B) corresponding to the selected person. The B terminal 100B receiving the predetermined message can display the image sharing object 1702 corresponding to the predetermined message on the touch screen 151B.

In the example described above with reference to FIG. 23, it is assumed that a message is transmitted only to one selected counterpart terminal, but it is obvious that, when a plurality of persons are selected, the predetermined message can be transmitted to all of the plurality of terminals selected.

In the example described above with reference to FIG. 23, a message is transmitted to the selected partner terminal through the partner selection window 2301. In an embodiment of the present invention to be described with reference to FIG. 24, it is proposed to transmit the predetermined message to the counterpart terminal corresponding to the position of the knocking input.

Fig. 24 shows that the same third image 2300 as in Fig. 23 is displayed, and that two persons, "Ahn Eun-hee" and "Seo Young Jeong" are recognized on the third image 2300. [

The control unit 180A according to an exemplary embodiment of the present invention proposes to transmit a predetermined message to a predetermined person when the knocking input 501-18 is received at the face position for a predetermined person.

When the knocking input 501-18 is received on the person named "Seo Young Jeong" as shown in Fig. 24A, the controller 180A controls the wireless communication unit 110A ). The B terminal 100B receiving the predetermined message can display the image sharing object 1702 corresponding to the predetermined message on the touch screen 151B.

25 is a flowchart illustrating a control method of identifying a counterpart corresponding to a hit input received on a predetermined image and transmitting a predetermined message to the counterpart party, according to an embodiment of the present invention. To explain the flowchart of FIG. 25, the control method shown in FIG. 17 will be described as an example.

As shown in FIG. 17A, the controller 180A outputs the first image 1701 through the A touch screen 151A (step S2501). In this case, the first image 1701 may be an image displayed through an image browsing function of a gallery application.

When receiving the tap input 501-11 on the first image 1701 browsing screen (step S2502), the A control unit 180A identifies the counterpart (B user) corresponding to the first image 1701 S2503). Thereafter, the A control unit 180A can control the wireless communication unit to transmit the shared request message to the identified other party (step S2504).

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (7)

A wireless communication unit for communicating with another terminal;
touch screen;
A sensor unit for sensing a tapping input received on the touch screen; And
Controls the touch screen to output a predetermined image,
And a control unit for controlling the wireless communication unit to identify a counterpart terminal corresponding to the predetermined image and transmit a predetermined message to the counterpart terminal when the tapping input received on the output predetermined image is sensed,
Mobile terminal. The method according to claim 1,
Wherein the control unit recognizes a face of at least one person included in the predetermined image,
Wherein the identified counterpart terminal is a terminal corresponding to the recognized face,
Mobile terminal. 3. The method of claim 2,
Further comprising a memory unit for storing at least one contact information and face recognition information together,
Wherein the controller identifies the counterpart terminal based on contact information corresponding to the recognized face among the stored at least one contact information,
Mobile terminal. The method according to claim 1,
Wherein the control unit attaches data on all or a part of the predetermined image to the predetermined message,
Mobile terminal. The method according to claim 1,
Further comprising a memory unit for storing at least one image data,
Wherein,
Controls the wireless communication unit to receive the reply message of the transmitted predetermined message,
Storing at least one comment information included in the received reply message in the memory unit together with the predetermined image,
Mobile terminal. 6. The method of claim 5,
The control unit, when receiving a comment display command for the predetermined image from the user through the touch screen,
And controlling the touch screen to output the comment information corresponding to the predetermined image stored in the memory unit.
Mobile terminal. Outputting a predetermined image on a touch screen;
Identifying a counterpart terminal corresponding to the predetermined image when detecting a tapping input received on the output predetermined image; And
And controlling the wireless communication unit to transmit a predetermined message to the identified counterpart terminal.
A method of controlling a mobile terminal.

Images