KR102026731B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal and a method of controlling the same so that the use of the terminal can be implemented in consideration of the user's convenience. According to at least one of the embodiments of the present invention, the mobile terminal detects the tapping input and the strength of the tapping input, identifies the counterpart through the sensing result, and simultaneously transmits and receives a message by simply sending and receiving a message. The advantage is that you can.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a mobile terminal and a method of controlling the same so that the use of the terminal can be implemented in consideration of the user's convenience.

Terminal can move It may be divided into a mobile terminal (portable terminal) and a stationary terminal depending on whether or not. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

As the terminal functions are diversified, for example, such a terminal is a multimedia player having a complex function such as taking a picture or a video, playing a music or video file, playing a game, or receiving a broadcast. Is being implemented.

In order to support and increase the function of such a terminal, it may be considered to improve the structural part and / or the software part of the terminal.

In the case of a mobile terminal, a touch screen is frequently used as an input / output means in order to secure portability of the mobile terminal. This is because the touch screen can perform functions as a user input unit and an output unit together, and can play a big role in providing intuitive control of the mobile terminal.

Intuitive control is one of the most important factors for the user who uses the mobile terminal. Various terminals are used everywhere in human life, because too many learning processes are required for the user to learn the control method of these terminals individually.

Therefore, the development of the control method of the mobile terminal is focused on the development of an input method more intuitive to the user.

One example of such an intuitive input method is tapping. The tapping input method refers to an input method in which a user strikes one area (i.e. touch screen) of the mobile terminal for a predetermined number of times (at least once or more). The tapping input method is similar to the knock operation in everyday life. Knock, in a dictionary sense, refers to the act of popping a door by knocking on a door before entering a room. Given this preliminary meaning, the tapping operation may be intuitive as the act of informing its presence to a mobile terminal or a predetermined counterpart that wishes to contact through the mobile terminal.

The mobile terminal may detect the tapping input through various sensors / methods.

As a first method for the mobile terminal to detect the tapping input, a tapping input through a touch screen may be detected. When the touch screen is activated, the touch input of the user input on the touch screen may be detected, and the tapping input may be detected through the detected touch input. In the case of using the first method, the tapping input may be limited on the touch screen.

As a second method for the mobile terminal to sense the tapping input, sensing of a tapping input through an acceleration sensor is possible. When the user taps on a region of the mobile terminal, the acceleration sensor may detect an acceleration change of the mobile terminal received by the tap input and transmit it to the controller. The controller may detect the tapping input through the acceleration change of the mobile terminal thus received. On the other hand, this second method has the disadvantage that the sensitivity of the tapping input may be somewhat lower than other input methods.

As a third method of detecting the tapping input by the mobile terminal, the tapping of the tapping input through the acceleration sensor may be detected while using the touch screen. If both methods are applied, the mobile terminal can detect the tapping input by compensating for the disadvantages caused by each method.

On the other hand, for such an intuitive input method, there is a need to discuss the detailed control method of the mobile terminal.

The present invention is proposed to meet the above-mentioned needs, and an object thereof is to provide a mobile terminal and a control method thereof capable of detecting a knock-on input received at a body of the mobile terminal.

The present invention is proposed to meet the above-mentioned needs, and an object thereof is to provide a more intuitive mobile terminal and a control method thereof by detecting a knock-on input received at the body of the mobile terminal.

The present invention is proposed to meet the above-mentioned needs, and an object thereof is to provide a mobile terminal and a control method thereof, which can easily contact a predetermined counterpart in response to a knock-on input received at a body of the mobile terminal. .

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.

The present invention to achieve the above object, the wireless communication unit for communicating with another terminal; touch screen; A sensor unit detecting a tapping input received on the touch screen; And controlling the touch screen to output a predetermined image, and upon detecting the tapping input received on the outputted image, identifies the counterpart terminal corresponding to the predetermined image and sends a predetermined message to the identified counterpart terminal. It provides a control unit for controlling the wireless communication unit to transmit.

The controller may recognize a face of at least one person included in the predetermined image, and the identified counterpart terminal may be a terminal corresponding to the recognized face.

The apparatus may further include a memory unit configured to store at least one contact information and face recognition information together. The controller may identify the counterpart terminal based on contact information corresponding to the recognized face among the stored at least one contact information. can do.

The controller may attach data about all or part of the predetermined image to the predetermined message.

And a memory unit for storing at least one image data, wherein the controller controls the wireless communication unit to receive a reply message of the transmitted predetermined message, and includes at least one included in the received reply message. Comment information may be stored together with the predetermined image in the memory unit.

The controller may control the touch screen to output the comment information corresponding to the predetermined image stored in the memory unit when receiving a comment display command for the predetermined image from the user. .

In addition, the present invention to achieve the above object, the step of outputting a predetermined image on the touch screen; Identifying a counterpart terminal corresponding to the predetermined image when a tapping input received on the outputted image is detected; And controlling the wireless communication unit to transmit a predetermined message to the identified counterpart terminal.

The effects of the mobile terminal and its control method according to the present invention will be described below.

According to at least one of the embodiments of the present invention, there is an advantage in that the knock-on input received by the body of the mobile terminal can be detected.

In addition, according to at least one of the embodiments of the present invention, there is an advantage that it is possible to provide an intuitive method for controlling the mobile terminal through the knock-on input received in the body of the mobile terminal.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned above may be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of an example of a mobile terminal or a mobile terminal according to the present invention;
3 is a rear perspective view of the portable terminal shown in FIG. 2.
Figure 4 is a rear perspective view showing the surface of the rear case by separating the rear cover of the mobile terminal according to an embodiment of the present invention.
5 is a diagram illustrating a conceptual diagram of transmitting a predetermined message in response to a tapping input in the control method of the mobile terminal 100 according to an embodiment of the present invention.
6 is a diagram illustrating a state diagram of recognizing a face included in an image and displaying a recognized result (face recognition information) together with the image according to an exemplary embodiment of the present invention.
FIG. 7 is a diagram illustrating a control method of transmitting a pre-stored message to a predetermined counterpart in a mobile terminal 100 according to an embodiment of the present invention in response to a tapping input received from a user.
8 is a diagram illustrating an example of an operation of a notification object displayed in response to receiving a status request message according to an embodiment of the present invention.
9 is a diagram for a control method of determining and transmitting one of a plurality of status request messages according to a user's selection according to an embodiment of the present invention.
FIG. 10 is a diagram for a control method of transmitting a status request message for further requesting a quick reply according to one embodiment of the present invention.
FIG. 11 is a diagram for a control method of detecting a pattern of a tapping input and transmitting a status request message corresponding to the detected pattern in the mobile terminal 100 according to one embodiment of the present invention.
12 is a diagram for a method of suggesting to transmit a status request message to a plurality of terminals by one input, according to an embodiment of the present invention.
FIG. 13 is a diagram for a control method of transmitting a reply message in response to a received status request message according to another embodiment of the present invention.
14 is a diagram for a control method of transmitting a message for prompting confirmation of a text message, according to one embodiment of the present invention.
FIG. 15 is a diagram for a control method of transmitting additional information together with a message for prompting confirmation of a text message according to one embodiment of the present invention.
FIG. 16 is a diagram for a control method of transmitting a confirmation completion message in response to a tapping input made on a received text message according to one embodiment of the present invention.
FIG. 17 is a diagram for a control method of transmitting a predetermined message when a tapping input on a gallery application is received according to one embodiment of the present invention.
FIG. 18 is a diagram for a control method of confirming a comment made on a predetermined picture, according to one embodiment of the present invention; FIG.
FIG. 19 is a diagram for a control method of identifying a counterpart for transmitting a sharing request message related to a predetermined image according to one embodiment of the present invention.
20 is a diagram for a control method of transmitting a message corresponding to a tapping input, which is performed on a terminal list capable of short-range communication according to one embodiment of the present invention.
FIG. 21 is a diagram for a control method of transmitting a message for requesting status sharing according to one embodiment of the present invention.
FIG. 22 is a diagram for a control method of a mobile terminal transmitting a connection establishment request message in response to a tapping input according to an embodiment of the present invention.
23 and 24 illustrate a control method of determining a reception counterpart of a message when there are a plurality of persons included in a predetermined image according to one embodiment of the present invention.
FIG. 25 is a flowchart illustrating a control method of identifying a counterpart in response to a tapping input received on a predetermined image and transmitting a predetermined message to the identified counterpart according to one embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the accompanying drawings. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, and the like, except where applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast reception modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast associated information refers to information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). -Handheld), DVB-CBMS (Convergence of Broadcasting and Mobile Service), OMA-BCAST (Open Mobile Alliance-BroadCAST), CMMB (China Multimedia Mobile Broadcasting), MBBMS (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services) Digital broadcast signals may be received using a digital broadcast system such as Digital Broadcast-Terrestrial. Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may include at least one of a base station, an external terminal, and a server on a mobile communication network such as, but not limited to, Global System for Mobile communications (GSM), Code Division Multiple Access (CDMA), and Wideband CDMA (WCDMA). Send and receive wireless signals with one. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the mobile terminal 100. Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), GSM, CDMA, WCDMA, Long Term Evolution), but is not limited to such.

In view of the fact that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc. is made through a mobile communication network, the wireless Internet module 113 for performing a wireless Internet access through the mobile communication network is the mobile communication module. It can be understood as a kind of (112).

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a GPS (Global Position System) module. According to the current technology, the location information module 115 calculates distance information and accurate time information away from three or more satellites, and then applies a triangulation method to the calculated information, thereby determining three-dimensional information according to latitude, longitude, and altitude. Current location information can be calculated accurately. Currently, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 may calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a button 136 and a touch sensor (static pressure / capacitance) 137 positioned on the front and rear or side surfaces of the mobile terminal 100, and although not shown, a keypad, It may be configured to further include a dome switch (dome switch), jog wheel, jog switch and the like.

The sensing unit 140 detects the current state of the mobile terminal 100 such as the open / closed state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, the acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 may include a gyroscope sensor, an acceleration sensor, a geomagnetic sensor, and the like.

For example, if the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is used to generate an output related to visual, auditory, or tactile senses, which includes a display unit 151, a sound output module 152, an alarm unit 153, and a light emitting diode (LED) unit 603. ) And the haptic module 154 may be included.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, a plurality of display units may be spaced apart or integrally disposed on one surface of the mobile terminal 100, or may be disposed on different surfaces.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in the inner region of the mobile terminal wrapped by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch". The act of actually touching the pointer on the touch screen may be referred to as "contact touch". The position where the proximity touch is performed by the pointer on the touch screen may mean a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

The proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 may also output a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. Since the video signal or the audio signal may be output through the display unit 151 or the sound output module 152, in this case, the display unit 151 and the sound output module 152 may be a kind of alarm unit 153. May be classified.

The LED unit 603 may perform visual output of various colors using the LED device based on a control signal from the controller 180.

The haptic module 154 generates various haptic effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be used for stimulation such as a pin array vertically moving with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet, grazing to the skin surface, contact of an electrode, and electrostatic force. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the controller 180 and may temporarily store input / output data (for example, a phone book, a message, an audio, a still image, a video, etc.). It can also perform a function. The memory 160 may store a frequency of use of each of the data (eg, a phone number, a message, and a frequency of use of each multimedia).

In addition, the memory 160 may store data on vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits the data inside the mobile terminal 100 to an external device. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the mobile terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be transferred. It may be a passage that is delivered to the terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The battery may be a built-in battery made to be chargeable, and may be detachably coupled to the terminal body for charging. The connection port may be configured as an example of the interface unit 170 to which an external charger for supplying power for charging the battery is electrically connected.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented in software applications written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, in describing an embodiment of the present invention, the display unit 151 will be described on the assumption that the touch screen 151 is used. However, embodiments of the present invention are not limited to the touch screen 151.

In addition, in the embodiment of the present invention, the touch gesture refers to a gesture implemented by touching or touching the touch screen 151, and the touch input refers to an input received by the touch gesture.

Touch gestures can be tapped, touch & drag, flicking, press, multi touch, pinch in, pinch out, depending on the action. And the like.

Tapping is an operation of lightly pressing and releasing the touch screen 151 once, and means a touch gesture such as a mouse click in a general personal computer.

In addition, touch drag is an operation of releasing after moving to a specific position while releasing a touch on the touch screen 151. When dragging an object, the object may be continuously moved and displayed according to the drag direction.

In addition, flicking refers to an operation of detaching a contact after moving in a specific direction (up, down, left, right, or diagonal) after touching the touch screen 151, and the mobile terminal 100 touch inputs by flicking. When received, processing of the specific operation is performed based on the flicking direction, speed, and the like. For example, a page turning operation of an e-book may be performed based on the flicking direction.

In addition, the press refers to an operation of continuously maintaining the touch for a preset time after touching the touch screen 151.

In addition, the multi-touch refers to an operation of simultaneously touching a plurality of points of the touch screen 151.

In addition, pinch-in refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers in multi-touch approach each other. That is, the drag starts from at least one point of the plurality of touched points on the touch screen 151 and occurs in a direction in which the plurality of touched points close to each other.

In addition, pinch-out refers to an operation of dragging the touch screen 151 in a direction away from the plurality of pointers in multi-touch. That is, the drag starts from at least one point among a plurality of points that are multi-touched on the touch screen 151 and occurs in a direction in which the plurality of points that are multi-touch are separated from each other.

2 is a front perspective view of an example of a mobile terminal or a mobile terminal according to the present invention;

The disclosed mobile terminal 100 has a terminal body in the form of a bar. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

The body of the mobile terminal 100 includes a case 101, 102, 103 forming the appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are built in the space formed between the front case 101 and the rear case 102.

In some cases, an electronic component may be mounted on the surface of the rear case 102. Electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, a memory card, and the like, which the user needs to remove. In this case, the rear case 102 may further include a rear cover 103 for covering the surface thereof. The rear cover 103 is formed of a structure that is easily removable by the user, and when the rear cover 103 is removed, the surface of the rear case 102 is exposed.

When the rear cover 103 is coupled as shown in FIG. 2, only a part of the side surface of the rear case 102 may be exposed, and when the size of the rear cover 103 is reduced, the rear surface of the rear case 102 may be exposed. Some may be exposed. When the rear cover 103 covers the entire rear surface of the rear case 102, the rear cover 103 may include an opening 103 ′ for exposing the camera 121 ′ or the sound output unit 152 ′ to the outside.

The cases 101, 102, and 103 may be formed by injecting synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output module 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface unit 170 may be disposed in the terminal cases 101 and 102. .

The display unit 151 occupies most of the main surface of the front case 101. The sound output module 152 and the camera 121 are disposed in regions adjacent to one end of both ends of the display unit 151, and the user input unit 131 and the microphone 122 are disposed in regions adjacent to the other end. The user input unit 132 and the interface unit 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of manipulation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjusting the volume of the sound output from the sound output module 152. The third operation unit 133 may receive a command such as switching to the touch recognition mode of the display unit 151.

3 is a rear perspective view of the portable terminal shown in FIG. 2.

Referring to FIG. 3, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 ′ has a photographing direction substantially opposite to that of the camera 121 (see FIG. 2), and may be a camera having different pixels from the camera 121.

For example, the camera 121 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the camera 121 'photographs a general subject and does not transmit it immediately. It is desirable to have a high pixel because there are many. The cameras 121 and 121 'may be installed on the terminal body to be rotatable or pop-up.

A flash 123 and a mirror 124 are further disposed adjacent to the camera 121 '. The flash 123 shines light toward the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to see his / her own face or the like when photographing (self-photographing) the user using the camera 121 '.

The sound output unit 152 'may be further disposed on the rear surface of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

The antenna 116 for receiving a broadcast signal may be additionally disposed on the side of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be pulled out of the terminal body.

Figure 4 is a rear perspective view showing the surface of the rear case by separating the rear cover of the mobile terminal according to an embodiment of the present invention. 4, the front case 101, the rear case 102, the rear cover (or battery cover) 103, the camera 121 ', the interface unit 170, the microphone 122, speaker module sound output The unit 154152 ', the battery 191, the battery mounting unit 104, the USIM card mounting unit 166, and the memory card mounting unit 167 are shown.

The rear case 102 may have a space on which an external component such as a battery mounting unit 104, a USIM card mounting unit 105, and a memory card mounting unit 106 may be mounted. In general, the exterior parts mounted on the surface of the rear case 102 are intended to expand the functions of the mobile terminal 100 in order to satisfy the demands of the diversified and diversified functions of the mobile terminal 100. to be.

As the performance of the mobile terminal 100 is diversified, the battery 191 may be configured as a replaceable type as illustrated in FIG. 4 to compensate for the large power consumption. In the case of the replaceable type, the battery mounting part 104 is formed on the surface of the rear case 102 so that a user can attach and detach it. The battery mounting unit 104 includes a connection terminal to be electrically connected to a component mounted in the case.

As shown in FIG. 4, the USIM card mounting unit 166 or the memory card mounting unit 167 may be formed next to the battery mounting unit 104, or formed on the bottom surface of the battery mounting unit 104. When it is separated from the battery mounting portion 104 may be formed to be exposed to the outside. In this case, the size of the battery mounting unit 104 may be larger, and thus the battery 191 may be enlarged.

4 illustrates a configuration in which the USIM card mounting unit 166 or the memory card mounting unit 167 is mounted on the rear side of the rear case 102, but can be inserted into and detached from the mobile terminal 100 by inserting from the side. Do.

The rear cover 103 covers the surface of the rear case, and fixes the battery 191, USIM card, memory card, etc. mounted on the surface of the rear case 102 so as not to be separated, and from external impact or foreign matter. Protect the exterior parts. Recently, a waterproof structure (not shown) may be further included by adding a waterproof function to seal the rear case 102 and the rear cover 103 so that water is not introduced into the exterior part.

As described above, it is assumed that the mobile terminal 100 according to an embodiment of the present invention not only senses a user's tapping input but also can sense the strength of the tapping input.

According to the first method of detecting the tapping input described above, the mobile terminal 100 may detect the tapping input by sensing the user's touch input through the touch screen 151. For example, when the duration of the touch input of the touch screen 151 is shorter than a predetermined time (for example, 0.1 second), the controller 180 taps a touch input input through the touch screen 151. You can judge that. This is because, in the case of a tapping input, the touch input must be received and released within a short time.

If the tapping input is defined as a tapping input two or more times, if the corresponding touch input is input a predetermined number of times during a predetermined time interval, the controller 180 may determine that the tapping input has been received.

Furthermore, the controller 180 according to the first method may determine the touch area of the user's touch input received through the touch screen 151 and determine the strength of the tapping input in proportion to the width of the touch area. . When the tapping input having a relatively weak strength is received by the user, a touch area having a smaller area than the strong tapping input may be formed. This is because, as more pressure is applied to the finger performing the touch, the area of the finger touching the touch screen 151 increases.

Meanwhile, the controller 180 according to the second method for detecting a tapping input receives a tapping input by detecting an acceleration change of the mobile terminal according to a tapping input of the user, and senses the strength of the tapping input to detect the tapping input. Will be detected.

Finally, in the case of the third method of combining both the touch screen of the first method and the acceleration sensor of the second method, in order to detect the strength of the tapping input, the intensity sensing method in the first method and the second method Can be combined.

On the other hand, while the touch screen 151 is activated, the tapping input 601 inputted on the touch screen 151 needs to be clearly distinguished from the general touch input. According to an embodiment of the present invention, the first method for distinguishing the tapping input 601 from the general touch input is distinguished from the general touch input according to the strength of the input. That is, the mobile terminal 100 according to an embodiment of the present invention recognizes as a general touch input when the touch input is input with an intensity greater than the predetermined reference intensity, and taps when the input is smaller than the predetermined reference intensity. Can be recognized.

According to an embodiment of the present invention, the second method for distinguishing the tapping input 601 from the general touch input is classified according to the duration of the touch input. That is, the mobile terminal 100 according to an embodiment of the present invention recognizes as a general touch input when the touch input is input for a time longer than a predetermined reference time, and taps when the touch input is input for a time shorter than the predetermined reference time. Can be recognized.

According to an embodiment of the present invention, the third method for distinguishing the tapping input 601 from the general touch input is classified according to whether there is a continuous touch input. That is, the mobile terminal 100 according to an embodiment of the present invention recognizes as a general touch input when a touch input is input once during a predetermined reference section, and when a touch input is input two or more times during the predetermined reference section, it is a tapping input. I can recognize it.

In an embodiment of the present invention to be described below, it will be described on the premise that the intensity of the tapping input can be sensed through at least one of the above-described methods.

5 is a diagram illustrating a conceptual diagram of transmitting a predetermined message in response to a tapping input in the control method of the mobile terminal 100 according to an embodiment of the present invention.

In one embodiment of the present invention, an intuitive operation of the tapping input 501 will be proposed. As described above, the tapping input 501 is used as a knock operation in everyday life, and is interpreted as an operation for notifying someone of his or her presence in the dictionary meaning of the knock operation. Therefore, the mobile terminal 100 according to an embodiment of the present invention, when a tapping input is received from a user, informs a certain party of his or her presence or whether the other party can be contacted (call or send a text message or Propose to send a message (hereinafter referred to as a status request message). That is, as shown in FIG. 5, when the terminal A 100A according to an embodiment of the present invention receives a tapping input 501 from the user, the terminal A transmits a status request message to the terminal B 100B. The wireless communication unit 110 may be controlled.

Transmission of a message according to an embodiment of the present invention may have a difference from transmission and reception of a general text message in the following points. First, according to one embodiment of the present invention, it is possible to transmit through a simple and intuitive input than sending and receiving a general text message.

Second, it is easy to specify the receiving party. There may be various types of objects output through the touch screen. If a predetermined counterpart (terminal counterpart's terminal) can be specified by various types of objects output as described above, an embodiment of the present invention can be applied. That is, when a tapping input is received on the corresponding object, the message can be transmitted by specifying the corresponding counterpart terminal.

Third, it uses pre-stored text messages. Therefore, when sending a message to the other party, it does not require a text input separately. Furthermore, an embodiment of the present invention further proposes a method of distinguishing a simple intention (sending message) of a sender. According to the pattern of the tapping operation or the user's selection input received after the tapping operation, by selecting any one of the pre-stored text messages, the sender's intention to send the message may be transmitted together.

In an embodiment of the present invention described below, in response to a tapping input received from a user, the A terminal 100A identifies a counterpart (specifically, a counterpart terminal) to which a predetermined message is to be transmitted, the A terminal 100A. ) A method of selecting / composing a predetermined message, a method of displaying a message received by the B terminal 100B, a method of replying a message by the B terminal 100B, and a reply of the B terminal 100B. A method of displaying the terminal A 100A will be described in detail.

In order to explain the embodiments of the present invention, A terminal 100A and B terminal 100B are representatively represented, and components of each terminal will be distinguished using A and B. FIG. That is, in representing the controller 180 in the configuration of the mobile terminal 100, the controller of the terminal A 100A is indicated by the controller A 180A, and the controller of the terminal B 100B is the controller B 180B. I will display it.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as described above will be described with reference to the accompanying drawings.

Hereinafter, face recognition and face recognition information in an image will be described with reference to FIG. 6.

In the drawings for explaining an embodiment of the present invention to be described below, the case forming the appearance of the mobile terminal 100 is omitted for clarity of the drawings, the screen output to the touch screen 151 of the mobile terminal 100 Only the state diagram of FIG.

FIG. 6 is a diagram illustrating a state diagram of recognizing a face included in an image, and displaying a recognized result (face recognition information) together with the image, according to an exemplary embodiment.

FIG. 6A illustrates a state diagram in which an image is generally viewed, and three persons are included in the displayed image. The controller 180 according to an embodiment of the present invention may recognize a face for each person included in the image through an algorithm for analyzing the face on the image. The algorithm may analyze the eyes, nose or mouth of the person in the image, and recognize the face of the person using the analyzed eyes, nose or mouth. Hereinafter, in the detailed description for explaining an embodiment of the present invention, the result recognized through the algorithm will be referred to as face recognition information. The face recognition information may include relative position information of the face recognized on the entire area where the image is output. When the number of people appearing in the picture is plural, the face recognition information may be individual information about each of at least one person of the plurality of people. Therefore, when a plurality of people are included in the image, the face recognition information of the image may include a result of face recognition of at least one of the plurality of people.

FIG. 6 (b) shows a state diagram for displaying a recognized face to be identified according to an embodiment of the present invention. The controller 180 may output the face indicators 601-1 to 601-3 together with the recognized face on the output picture. That is, the controller 180 may display the face indicators 601-1 to 601-3 together with the output of the picture based on the position information of the face included in the analyzed face recognition information.

Furthermore, the algorithm can distinguish between the recognized face or the same person by analyzing features of different eyes, noses or mouths for each person. That is, the controller 180 may determine whether the face is the same as compared with the pictures previously stored in the contact through the face recognized from the picture. Accordingly, when it is determined that the face is the same as the face previously stored in the contact as a result of recognizing the face, the controller 180 may further display additional information stored in the contact of the person.

That is, the controller 180 may analyze and identify the face in the image and match the face with specific contact information. The matched contact information may be additionally displayed on the image.

As an example of the additional information, the controller 180 in the example of FIG. 6C may output the name tags 602-1 to 602-3 of the recognized face person together with the picture as additional information.

FIG. 7 illustrates a conceptual diagram of a control method of transmitting a pre-stored message to a predetermined counterpart in response to a tapping input received from a user in the mobile terminal 100 according to an embodiment of the present invention.

As shown in FIG. 7A, the controller 180A outputs at least one object through the A touch screen 151A. Referring to FIG. 7A, the A touch screen 151A of the terminal A 100A displays a contact list in an execution state diagram of a telephone transmission / reception application, and outputs at least one contact object on the contact list. As shown in FIG. 7A, when a tapping input 501-1 is received on a contact object called “team leader”, the A controller 180A may identify a counterpart terminal corresponding to the contact object called “team leader”. Can be. In more detail, the A controller 180A may identify the A controller 180A using a phone number or other terminal identification information of the counterpart terminal corresponding to the contact object “team leader”. Subsequently, the A controller 180A may control the A wireless communication unit 110A to transmit the first status request message to the identified counterpart terminal 100B.

The status request message may mean a message transmitted in response to a tapping input and may be a previously stored message. In addition, a specific message may be selected from a plurality of pre-stored messages, and the selected message may be transmitted. The process of selecting a specific message from among the pre-stored messages and the plurality of messages will be described below with reference to FIGS. 9 to 11. In the embodiment described with reference to FIG. 7, it is assumed that there is one pre-stored message.

The first status request message may include identification information of the transmitter A terminal 100A. The identification information of the transmitting terminal A terminal 100A may be a contact information. Similarly, the status request message described below may also include identification information of the transmitting terminal A 100A.

Referring to FIG. 7B again, the B terminal 100B displays the lock screen through the B touch screen 151B. The terminal B (100B) receiving the first status request message from the terminal A (100A) indicates that the first status request message has been received through the touch screen 151B as shown in FIG. The first notification object 700 may be displayed.

In the example illustrated in FIG. 7 (c), the first notification object 700 may be immediately displayed on the lock screen, and may include any one of a picture of the counterpart who sent the message or a picture of the person who received the message. Can be. Meanwhile, embodiments of the present invention may be applicable as long as the object of the notification object is not limited to the first notification object 700 and can notify the user in any form.

Upon receiving the input 501-2 from which the first notification object 700 is selected from the user (hereinafter referred to as B user) of the B terminal 100B, the B controller 180B may receive at least one reply option icon 701a. To 701c may be displayed on the B touch screen 151B. Subsequently, when the user B receives an input 501-3 from which at least one option icon of the at least one reply option icon 701a to 701c is selected, the B controller 180B sends a second status request message to the A terminal. The B wireless communication unit 110B can be controlled to return 100A.

On the other hand, in the example shown in Fig. 7D, it is assumed that the option icon includes a call origination option icon 701b, and the call origination option icon 701b is selected by the user B. The call origination option icon 701b is an option for making a call to the terminal A 100A that has transmitted the first status request message and replying thereto. The controller B 180B sends a call signal to the terminal A 100A correspondingly. It is possible to control the B wireless communication unit 110B to transmit (see Fig. 7 (d) and (e)).

The terminal A 100A having received the call signal from the terminal B 100B can output a pop-up window 702 indicating that the call signal is being received (see FIG. 7E).

In FIG. 7, after receiving the first status request message, the B terminal 100B controls to display the first notification object 700 through the B touch screen 151B. Hereinafter, an additional operation of the first notification object 700 will be described with reference to FIG. 8.

8 is a diagram illustrating an example of an operation of a notification object displayed in response to receiving a status request message according to an embodiment of the present invention.

In FIG. 8A, the B terminal 100B displays the first notification object 700 in response to the reception of the status request message. In one embodiment of the present invention, it is proposed that the first alarm object 700 gradually decreases with time (see FIGS. 8B and 8C).

Because, the purpose of an embodiment of the present invention described with reference to FIG. 8 is, through a tapping input (knock input) to request a reply to the status of the time of transmitting a status request message to the other party (user B) Is to send a request message. For this reason, if user B 100B does not respond immediately, the point of time desired by the sender elapses. Accordingly, the B controller 180B may control the size of the alarm object to be gradually reduced, and control to stop displaying the alarm object when the size of the alarm object is smaller than the predetermined size (after a predetermined time).

In an embodiment of the present invention described with reference to FIGS. 6 to 8, a message asking for a state of a simple receiving counterpart is transmitted. Furthermore, in another embodiment of the present invention, which will be described below with reference to FIGS. 9 to 11, it is proposed to transmit a message suggesting a specific action to a receiving counterpart. That is, in the above-described embodiment, if the type of the status request message to be transmitted does not vary, the embodiments to be described later propose to vary. Accordingly, the mobile terminal 100 according to an embodiment of the present invention proposes to store and store a plurality of status request messages before determining and transmitting one status request message according to a user input pattern or selection. Hereinafter, with reference to the drawings will be described in detail.

9 is a diagram for a control method of determining and transmitting one of a plurality of status request messages according to a user's selection according to an embodiment of the present invention.

Referring to FIG. 9A, at least one contact object is displayed on the A touch screen 151A, and a tapping input on the “team leader” contact object is performed through the same A touch screen 151A as in FIG. 7. It is assumed that 501-1) is received.

Unlike in FIG. 7, the A controller 180A may display at least one theme object 901a to 901c corresponding to the tapping input 501-1. When the user A selects 10a of any of the displayed at least one theme object 901a to 901c, the user A proposes to transmit a second status request message based on the selected theme object. That is, the terminal A 100A stores each of the plurality of status request messages in association with the theme, and determines the status request message corresponding to the theme selected by the selection of the theme object among the stored status request messages. Can be sent to.

The theme in the theme object may include at least one of movies, coffee, meals, and walks. In the example illustrated in FIG. 9B, the third theme object 901c which proposes coffee among the first to third theme objects 901a to 901c is selected. The A controller 180A may control the A wireless communication unit 110A to transmit a second status request message corresponding to the selected third theme object 901c. The user A may ask the user B whether the user can drink the selected coffee option 'coffee' through the second status request message. Accordingly, user A may convey his intention to user B with a simple operation.

Upon receiving the second status request message, the B controller 180B of the B terminal 100B may communicate the intention of the A user by displaying the third theme object 901c together with the first notification object 700 ( See FIG. 9 (d)). In the example shown in FIG. 9 (d), the third suggestion option icon 901c is shown as an icon drawn with a coffee shape.

In the above-described embodiment with reference to FIG. 9, it is proposed to transmit a user's intention to transmit through a plurality of theme selections. Hereinafter, FIG. 10 proposes a control method capable of transmitting a user's urgency / urgency.

FIG. 10 is a diagram for a control method of transmitting a status request message for further requesting a quick reply according to one embodiment of the present invention.

According to the above embodiment of the present invention, user A transmits a message requesting a predetermined reply to user B. However, if the user B does not reply or the situation is urgent and needs a quick reply, the user A may want to send a message prompting a reply. In one embodiment of the present invention, an input for transmitting a message for prompting a reply is proposed as a case where a number of tapping inputs is input. That is, when the terminal A receives a tapping input (hereinafter, referred to as a multiple tapping input) a predetermined number of times or more within a predetermined time interval, the terminal A 100A receives a status request message requiring a quick reply (hereinafter, referred to as a third status request message). Can be transmitted to the B terminal 100B.

As shown in FIG. 10 (a), the A terminal 100A displays at least one contact object, and when the multi-knock input 1001 is received on the contact object "team leader", the A controller 180A May transmit a third status request message to the B terminal 100B.

The terminal B receiving the third status request message, which is a message for requesting a quick reply, may display the first notification object 700 and may display the highlight indicator 1002 in order to indicate that a quick reply is requested. Can display more.

Hereinafter, in FIG. 11, it is proposed to further detect a pattern of a tapping input of the user and determine a status request message according to the pattern of the tapping input.

FIG. 11 is a diagram for a control method of detecting a pattern of a tapping input and transmitting a status request message corresponding to the detected pattern in the mobile terminal 100 according to one embodiment of the present invention.

The tapping pattern may include at least one of the number of tapping inputs, the strength of the tapping input, the time interval between tapping inputs when a plurality of tapping inputs are received, and the direction of the touch input received after the tapping input. However, the embodiment of the present invention is not limited to the type of tapping pattern.

Referring to FIG. 11 (a), the A terminal 100A displays at least one contact object and receives a tapping input 1101-1 having a first pattern on a 'team leader' contact object. Upon receiving the tapping input 1101-1 of the first pattern, the A controller 180A receives a fourth status request message corresponding to the tapping input 1101-1 of the first pattern among a plurality of pre-stored status request messages. And transmit the determined fourth status request message to the B terminal 100B.

In the example shown in FIG. 11A, the status request message corresponding to the tapping input 1101-1 of the first pattern is a status request message corresponding to the coffee theme, and the tapping input 1101-2 of the second pattern. Assume that the status request message corresponding to the status request message corresponding to the movie theme.

Upon receiving the fourth status request message, the B terminal 100B may display the third theme object 901c corresponding to the fourth status request message (see FIG. 11B). On the other hand, the terminal B receiving the fifth status request message corresponding to the tapping input 1101-2 of the second pattern 100B may display the first theme object 901a corresponding to the fifth status request message. (See FIGS. 11 (c) and (d)).

Furthermore, one embodiment of the present invention proposes to transmit a status request message to a plurality of terminals by one input. Such an embodiment will be described with reference to FIG.

12 is a diagram for a method of suggesting to transmit a status request message to a plurality of terminals by one input, according to an embodiment of the present invention.

Referring to FIG. 12 (a), the terminal A 100A displays at least one contact object, and taps on each of the 'Jiyoung' contact object and the 'team leader' contact object (501-4 and 501-5). ). That is, when a tapping input is received on a plurality of objects, the A controller 180A may determine a plurality of counterparts corresponding to each object, and transmit a status request message to each of the determined plurality of counterparts. The tapping input made on the plurality of objects may allow the user to make the tapping input using a plurality of fingers.

In the example shown in FIG. 12A, the A controller 180A having received the tapping inputs 501-4 and 501-5 controls the B terminal 100B and the C terminal 100C corresponding to each contact object. Decide Subsequently, the A controller 180A can transmit a status request message to each of the determined B terminal 100B and the C terminal 100C.

As shown in (b) and (c) of FIG. 12, each of the B terminal 100B and the C terminal 100C receiving the status request message may display the first notification object 700.

In the above-described embodiment, a control method of transmitting a status request message has been described. In an embodiment to be described below, a control method for transmitting a reply message in response to the received status request message by the terminal receiving the status request message will be described.

FIG. 13 is a diagram for a control method of transmitting a reply message in response to a received status request message according to another embodiment of the present invention.

Referring to FIGS. 13A and 13C, terminal B (100B) is in a state of receiving a status request message from terminal A (100A), and according to an embodiment of the present invention, the first notification object 700. Is displayed on the B touch screen 151B.

In a terminal receiving a status request message according to an embodiment of the present invention, when a tapping input is received from a user, the terminal proposes to create and send a reply message further including additional information according to the number of fingers performing the tapping input.

As shown in FIGS. 13A and 13B, when a tapping input (hereinafter, the first multiple tapping input) 1301-1 is received using a first number of fingers, the B controller 180B receives the first additional information. The first reply message including the message may be transmitted. The first additional information may include time information. In the example shown in FIG. 13 (b), the first additional information includes information on the time taken for the user B to be able to be contacted at the same time while informing that the user B is currently unable to contact.

The terminal A 100A receiving the first reply message may display a pop-up window 1302 displaying the contents of the first reply message.

In the example of FIGS. 13A and 13B, tapping using two fingers The first multiple tapping input may indicate that the time taken until the user can be contacted is about 2 hours. Accordingly, the pop-up window 1302 may display information indicating that the call counterpart in FIG. 13 (b) can talk after 2 hours.

Subsequently, as shown in FIGS. 13C and 13D, when the tapping input (second multiple tapping input) 1301-2 is received using the second number of fingers, the B controller 180B receives the second additional information. It may transmit a second reply message including. The terminal A 100A receiving the second reply message may display a pop-up window 1302 displaying the contents of the second reply message.

In the example of FIGS. 13C and 13D, tapping using three fingers may indicate that the time required for the user to be in contact is about 3 hours. Accordingly, the pop-up window 1302 in FIG. 13D may display information indicating that the called party can talk after 3 hours.

Furthermore, in one embodiment of the present invention, it is proposed to further send a message prompting the other party to confirm the text message. Such an embodiment will be described with reference to FIGS. 14 and 15.

14 is a diagram for a control method of transmitting a message for prompting confirmation of a text message, according to one embodiment of the present invention.

In FIG. 14A, the terminal A 100A displays at least one object through the touch A screen 151A. In more detail, the at least one object may be a transmission text message object 1401. When the tapping input 501-6 is received on the transmission text message object 1401, the A controller 180A identifies the other terminal (terminal B) corresponding to the transmission text message object 1401, and identifies the other party. A confirmation prompt message may be further sent to the terminal 100B (see FIG. 14B). The identified counterpart means a called party of the transmitted text message.

Upon receiving the confirmation prompt message, the terminal B 100B may further display a popup window 1402 indicating that the confirmation prompt message is received through the B touch screen 151B, as shown in FIG. 14B. . When the terminal B receives a tapping input 501-7 on the pop-up window 1402 from the user B, the terminal B 100B may further control to transmit a confirmation completion message indicating that the confirmation prompt message is confirmed (FIG. 14 ( c) and (d)). Subsequently, the terminal A 100A receiving the confirmation completion message from the terminal B 100B may further display a popup window 1403 indicating that the confirmation completion message has been received as shown in FIG.

Meanwhile, a control method of additionally designating a theme in addition to the confirmation prompt message described above will be described with reference to FIG. 15.

FIG. 15 is a diagram for a control method of transmitting additional information together with a message for prompting confirmation of a text message according to one embodiment of the present invention.

Referring to FIG. 15A, at least one object is displayed through the A touch screen 151A. In more detail, the at least one object may be a transmission text message object 1401. When the tapping input 501-8 is received on a predetermined phrase included in the transmission text message object 1401, the A controller 180A may transmit a confirmation prompt message including a theme corresponding to the predetermined phrase. .

For example, when the tapping input 501-8 is received in the phrase "Coffee" included in the transmission text message object 1401, the A controller 180A transmits the coffee theme information together with the confirmation prompt message. can do. The terminal B receiving the coffee theme information together with the confirmation prompt message 100B may display a third theme object 901c indicating the coffee theme together with the first notification object 700.

Referring to FIG. 15C, the transmission text message object 1401 is displayed through the A touch screen 151A. In the example shown in FIG. 15C, the tapping input 501-9 is received at the phrase “Movie” included in the transmission text message object 1401. When the tapping input 501-9 is received, the A controller 180A may transmit the movie theme information together with the confirmation prompt message. The terminal B receiving the movie theme information together with the confirmation prompt message 100B may display the first theme object 901a indicating the movie theme together with the first notification object 700.

The above-described embodiment is a control method of transmitting an acknowledgment message when a tap input is received on a transmission text message object. Hereinafter, a control method of transmitting a confirmation completion message when receiving a tapping input on a received text message object will be described.

FIG. 16 is a diagram for a control method of transmitting a confirmation completion message in response to a tapping input made on a received text message according to one embodiment of the present invention.

Referring to FIG. 16A, the terminal A 100A shows an execution state diagram of a text transmission / reception application through the A touch screen 151A, and the execution state diagram includes at least one received text message object 1601. Include.

When the tapping input 501-10 is received on the received text message object 1601, the controller 180A identifies a counterpart corresponding to the received text message object 1601 and sends a confirmation completion message to the identified counterpart. I can send it. The identified counterpart may be a transmitting counterpart of the received text message object 1601.

Upon receiving the confirmation completion message, the B terminal 100B may display a pop-up window 1602 including a guide indicating that the user A has confirmed the text message on the B touch screen 151B.

The present invention further proposes an embodiment in which the tapping input is made on a photo browsing screen on a gallery application. Such embodiments will be described below with reference to FIGS. 17 to 20.

FIG. 17 is a diagram for a control method of identifying a counterpart in response to a tapping input received on a predetermined image and transmitting a predetermined message to the identified counterpart according to one embodiment of the present invention.

Referring to FIG. 17A, the user A views the first image 1701 through the photo viewing application of the terminal A 100A. When the tap input 501-11 is received on the first image 1701 reading screen, the A controller 180A identifies the counterpart (user B) corresponding to the first image 1701. In addition, the A controller 180A may transmit a sharing request message for the identified counterpart. The sharing request message may mean a message for the user A to share a view of the image with respect to the first image 1701.

In the example illustrated in FIG. 17, the identified user recognizes at least one character face on the first image 1701 through a face recognition algorithm and is a counterpart corresponding to the recognized face.

The B terminal 100B receiving the sharing request message may further display the image sharing object 1702 through the B touch screen 151B. The image sharing object 1702 may include a display of all or part of the first image 1701 displayed on the terminal A 100A (see FIG. 17B).

Upon receiving the image sharing object 1702, the B controller 180B may display a comment creation popup window 1703 for receiving a comment from the user according to a user's selection. For example, when an input for touching the shared object 1702 is received, the B controller 180B may display a comment writing popup window 1703 on the B touch screen 151B to receive a comment in the first image 1701. I can display it.

If the confirmation button is pressed after the comment is created via the displayed comment creation popup window 1703, the B controller 180B can send a comment creation message including the created comment to the A terminal 100A.

The terminal A 100A receiving the comment creation message can control the A touch screen 151A to display a popup window 1704 displaying the created comment.

FIG. 18 is a diagram for a control method of confirming a comment made on a predetermined picture, according to one embodiment of the present invention; FIG. In FIG. 18, it is assumed that the same comment writing message is received as in terminal A of FIG. 17.

Referring to FIG. 18A, the user A views the image 1701 as shown in FIG. 17 through the photo viewing application of the terminal A 100A. When the image 1701 is received while the image 1701 is received, a popup window 1801 displaying a comment created in relation to the image 1701 may be displayed. The popup window 1801 may include the plurality of comments when there are a plurality of comments created in relation to the image 1701.

In the embodiment described above with reference to FIG. 17, a face recognition algorithm is applied to a predetermined image to identify a sender of a message, but the present invention is not limited thereto. Another example will be described with reference to FIG. 19.

FIG. 19 is a diagram for a control method of identifying a counterpart for transmitting a sharing request message related to a predetermined image according to one embodiment of the present invention.

Referring to FIG. 19A, a user A views a second image 1900 through a photo viewing application of terminal A 100A. When the tapping input 501-12 is received on the second image 1900, the A controller 180A may display a counterpart identification popup window 1901 for identifying a predetermined counterpart. The counterpart identification popup window 1901 in the embodiment related to FIG. 19 is a popup window for selecting a message transmission counterpart from a user, and a face recognition algorithm is not properly performed on a predetermined image, or on a contact corresponding to the recognized face. It may be displayed when the other party does not exist.

When at least one counterpart is selected through the counterpart identification popup window 1901, the A controller 180A may transmit a sharing request message in FIG. 18 to the at least one counterpart terminal identified.

The messages transmitted in response to the tapping input may also be applied using near field communication. A preferred embodiment for using near field communication will be described with reference to FIG. 20.

20 is a diagram for a control method of transmitting a message corresponding to a tapping input, which is performed on a terminal list capable of short-range communication according to one embodiment of the present invention.

Referring to FIG. 20A, an execution state diagram of a short range control application for performing short range communication using a predetermined short range communication method is illustrated. In the example illustrated in FIG. 20A, the state diagram of the short range control application indicates that there are no short range communication terminals currently connected.

Upon receiving a predetermined input for establishing a short-range communication connection, the A terminal 100A may display a terminal list in which the connected record exists. When the tapping input 501-13 is received on the object corresponding to the B terminal 100B in the terminal list, the A controller 180A may transmit a call message to the B terminal 100B. The call message is a message for notifying the user of the location of the terminal, and the terminal receiving the call message may inform the user of his location by outputting a predetermined notification signal. For example, the B terminal 100B receiving the call message controls the sound output module 152 to output a beep sound (see FIG. 20 (c)).

According to the above-described embodiment, a user who wants to establish short-range communication between two terminals has an advantage of easily specifying the other terminal through a tapping input on any one of the two terminals. This is because, if the terminals to be connected are simply provided as a list, it is difficult to specify which terminal.

FIG. 21 is a diagram for a control method of transmitting a message for requesting status sharing according to one embodiment of the present invention.

Referring to FIG. 21A, the terminal A 100A displays at least one contact object in a thumbnail view through the A touch screen 151A, and receives a tapping input 501-14 on a predetermined contact object. do.

Upon receiving the tapping input 501-14, the A controller 180A transmits a state sharing request message to the B terminal 100B. Receiving the status sharing request message, the terminal B 100B displays a pop-up window 2002 asking whether to share the state, and when receiving the input from the user B to share, the terminal B transmits a reply message to the terminal A 100A. Can be.

The terminal B 100B according to an embodiment of the present invention may further transmit current location information of the terminal B 100B with a reply message. The terminal A 100A can display the received current position information of the terminal B 100B together with the map (see Fig. 21 (d)).

The terminal B 100B according to an embodiment of the present invention may transmit image data (which may be real time) received through the camera B 121A of the terminal B 100B together with a reply message. The terminal A 100A receiving the image data may display the image data received through the A touch screen 151A. If the image data is real time, the terminal A 100A may display the image data in a video call format. In the case of a video call format, the B terminal 100B may send voice data received through the B microphone 122B together with a reply message to add transmission and reception of the voice signal.

Meanwhile, in one embodiment of the present invention, in response to a tapping input, it is proposed to transmit a message requesting connection establishment through a predetermined application. This embodiment will be described with reference to FIG.

FIG. 22 is a diagram for a control method of a mobile terminal transmitting a connection establishment request message in response to a tapping input according to an embodiment of the present invention.

Referring to FIG. 22A, the A touch screen 151A of the terminal A 100A displays a contact list in an execution state diagram of a telephone transmission / reception application, and outputs at least one contact object on the contact list. As shown in FIG. 22A, when a tapping input 501-15 is received on the contact object "team leader", the controller A 180A may identify a counterpart corresponding to the contact object "team leader". have. Subsequently, the A controller 180A may control the A wireless communication unit 110A to transmit the sixth status message to the identified counterpart terminal 100B.

Referring to FIG. 22B, the terminal B 100B displays a lock screen through the B touch screen 151B. Receiving the sixth status request message from the A terminal 100A, the B terminal 100B indicates that the sixth status request message has been received through the B touch screen 151B as shown in FIG. 22 (c). The first notification object 700 may be displayed. The B controller 180B may display at least one reply option icon 701a, 701b, and 701d together with the first notification object 700 on the B touch screen 151B.

The fourth reply option icon 701d of the plurality of reply option icons displayed corresponds to an option for requesting establishment of a connection using a predetermined application.

The predetermined application is an application that can maintain a connection state between a plurality of terminals using the wireless communication unit 110, and means an application that can transmit and receive predetermined user input data while the connection state is maintained. The predetermined user input data may include not only text data input by the user, but also handwriting data by a user's handwriting input.

When the B terminal 100B receives an input from which the fourth reply option icon 701d is selected from the B user, the B terminal 100B includes a message requesting establishment of a connection by using the predetermined application while replying to the A terminal 100A. You can. After establishing a connection using the predetermined application, the A terminal 100A and the B terminal 100B which have established a connection may display execution state diagrams of the predetermined application (Figs. 22 (d) and (e)). Reference).

In the above-described embodiment of the present invention together with FIG. 17, the image transmission control method of recognizing a face included in a predetermined image and using the recognized face as a reception counterpart has been described. In the example of FIG. 17, only one person included in an image has been described. However, when there are a plurality of people included in the image, it may be unclear to whom. An embodiment of the present invention in this case will be described with reference to FIGS. 23 and 24. FIGS. 23 and 24 are according to an embodiment of the present invention when there are a plurality of persons included in a predetermined image. It is a figure which shows the control method of determining the receiver of a message.

In FIG. 23, it is proposed to receive a reception counterpart by a user.

Referring to FIG. 23, it is assumed that the third image 2300 is displayed and the third image 2300 includes two persons. The controller 180A may perform face recognition on two persons. In the example, it is assumed that two persons “An Eun Hee” and “Seo Young Jung” are recognized on the third image 2300.

When a tapping input 501-17 is received on the third image 2300, the controller 180A may display a counterpart selection window 2301 for requesting a selection from a user. The counterpart selection window 2301 may include a counterpart list including two persons "An Eun-hee" and "Seo Young-jung" recognized in the third image 2300. When the input 10b for selecting one is received, the controller 180A may transmit a predetermined message to the counterpart terminal (terminal B, 100B) corresponding to the selected person. The B terminal 100B receiving the predetermined message may display the image sharing object 1702 corresponding to the predetermined message on the touch screen 151B.

Meanwhile, in the example described above with reference to FIG. 23, it is assumed that only one selected counterpart terminal is to transmit a message. However, it will be apparent that the predetermined message can be transmitted to all selected plurality of terminals when a plurality of selected ones are selected.

In the example described above with reference to FIG. 23, a message is transmitted to the counterpart terminal selected through the counterpart selection window 2301. In an embodiment of the present invention to be described with reference to FIG. 24, it is proposed to transmit the predetermined message to the counterpart terminal corresponding to the position of the tapping input.

FIG. 24 assumes that the same third image 2300 is displayed as in FIG. 23, and two persons “An Eun-hee” and “Seo Young-jeong” are recognized on the third image 2300.

The controller 180A according to an embodiment of the present invention proposes to transmit a predetermined message to the counterpart when the tapping input 501-18 is received at the face position of the predetermined person.

When the tapping input 501-18 is received on the person named "Seo Young-Jung" as shown in FIG. ). The B terminal 100B receiving the predetermined message may display the image sharing object 1702 corresponding to the predetermined message on the touch screen 151B.

FIG. 25 is a flowchart illustrating a control method of identifying a counterpart in response to a tapping input received on a predetermined image and transmitting a predetermined message to the identified counterpart according to one embodiment of the present invention. In order to explain the flowchart of FIG. 25, the control method illustrated in FIG. 17 will be described as an example.

As shown in FIG. 17A, the controller 180A outputs the first image 1701 through the A touch screen 151A (step S2501). In this case, the first image 1701 may be an image displayed through an image browsing function of a gallery application.

When receiving the tapping input 501-11 on the screen for viewing the first image 1701 (step S2502), the A controller 180A identifies the other party (user B) corresponding to the first image 1701 ( Step S2503). Thereafter, the A controller 180A may control the wireless communication unit to transmit a sharing request message for the identified counterpart (step S2504).

It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

The present invention described above can be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include the controller 180 of the terminal.

Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface unit
180: control unit 190: power supply unit

Claims (7)

A wireless communication unit performing wireless communication;
touch screen;
A sensor unit detecting a tapping input received on the touch screen; And
Displaying an object corresponding to the counterpart terminal on the touch screen;
Receive multiple tapping inputs on the object,
Recognize the strength of the multiple tapping input and the multiple tapping input,
And a controller for transmitting a specific request message among pre-stored request messages to the counterpart terminal through the wireless communication unit in response to the multiple tapping input. Claim 2 has been abandoned upon payment of a set-up fee. The method of claim 1, wherein the control unit,
In response to the multiple tapping, display a plurality of theme objects corresponding to the object,
And when one of the theme objects is selected, transmitting a message corresponding to the selected theme object to the counterpart terminal as the specific request message. Claim 3 has been abandoned upon payment of a set-up fee. The method of claim 1, wherein the control unit,
And if another multiple tapping input is received on the object, sending the specific request message to the counterpart terminal as a prompt request message. Claim 4 has been abandoned upon payment of a setup registration fee. According to claim 1,
The object corresponds to a text message sent to the counterpart terminal,
The control unit transmits the specific request message to the counterpart terminal. Claim 5 was abandoned upon payment of a set-up fee. According to claim 1,
The specific request message corresponds to a message for prompting confirmation of a text message sent to the counterpart terminal. Claim 6 has been abandoned upon payment of a setup registration fee. According to claim 1,
The object corresponds to a text message received from the counterpart terminal,
The control unit transmits the specific request message to the counterpart terminal,
The specific request message corresponds to a message indicating that the user of the mobile terminal has confirmed the text message. Claim 7 was abandoned upon payment of a set-up fee. According to claim 1,
The specific request message corresponds to a message requesting to participate in a specific application with the mobile terminal,
The control unit allows the counterpart terminal to participate in the specific application when the request of the specific request message is accepted.

Images