KR20140113067A - Mobile terminal, message transceiving server and controlling method of mobile terminal - Google Patents

Abstract

The present invention relates to a mobile terminal providing a function of editing an order of displaying a plurality of messages transceived with a specific counterpart with various references, to a message transceiving server, and to a method for controlling the mobile terminal. The mobile terminal according to the present invention includes: a wireless communication unit configured to transceiver messages with at least one counterpart terminal; a touchscreen configured to display a plurality of first messages among the messages received by the wireless communication unit; and a control unit configured to determine whether a second message is matched with each of the first messages if the second message is inputted after the first messages were displayed, controlling the second message to be displayed at a position corresponding to a specific message among the first messages according to a result of the determination, and controlling arrangement information for displaying the second message at the position corresponding to the specific message on a terminal of the at least one specific counterpart to be transmitted to the terminal of the at least one specific counterpart via the wireless communication unit.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal, a message transmission / reception server, and a control method of a mobile terminal. [0002] MOBILE TERMINAL, MESSAGE TRANSCEIVING SERVER AND CONTROLLING METHOD OF MOBILE TERMINAL [

The present invention relates to a mobile terminal, a message transmission / reception server, and a control method for a mobile terminal, which provide a function of editing a plurality of messages transmitted and received in a specific direction with respect to different parties according to various criteria.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Using the above mobile terminal, a message can be exchanged with a remote party. Messages exchanged with a specific party are displayed in the order of transmission / reception time in the dialog window formed with the specific party. The dialog window may be formed for one partner, or for a plurality of partners. A plurality of parties included in one dialog window can exchange messages with each other, and the messages are displayed in order of transmission / reception time.

However, conventionally, there is no method for changing the order of the messages displayed in the dialog window as described above. It is difficult to recognize the contents of a conversation when a message having different contents is transmitted and received between two messages related to each other.

The present invention is proposed in order to satisfy the above-described need, and it is possible to display and change the order of messages displayed in the dialog window formed between one or more specific parties, different from the transmission / reception time order, And a control method of a mobile terminal, a message transmission / reception server, and a mobile terminal that can change the sequence of displayed messages correspondingly.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a communication system including a wireless communication unit for transmitting and receiving a message to and from at least one specific party; A touch screen for displaying a plurality of first messages among a plurality of messages received through the wireless communication unit; And if the second message is input after the plurality of first messages are displayed, determining whether the first message is matched with each of the plurality of first messages, and if the second message is a specific one of the plurality of first messages And the location information indicating that the second message is displayed at a position corresponding to the specific message in the terminal of the at least one specific counterpart is transmitted through the wireless communication unit to the terminal To the mobile terminal.

According to another aspect of the present invention, there is provided a message transmission / reception server for transmitting a plurality of messages between a first mobile terminal and a second mobile terminal, A message receiving unit receiving the arrangement position information; And transmitting the transmission message and the placement position information so that the transmission message is displayed at a position according to the placement position information in the second mobile terminal regardless of the time order in which the plurality of messages are transmitted and received, And a message transmission unit for transmitting the message to the second mobile terminal.

According to another aspect of the present invention, there is provided a method of transmitting a message, the method comprising: receiving a first response request message and a second response request message from at least one other party; Displaying the first response request message and the second response request message according to a reception order; Receiving an answer message; Determining whether the first and second answer request messages are matched with the input answer message; Determining and displaying a location where the answer message is displayed according to the matching; And transmitting information on the determined location to the at least one specific counterpart with the response message.

Effects of the control method of the mobile terminal, the message transmission / reception server, and the mobile terminal according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the control unit transmits a specific message in a dialog window formed between the user and the at least one specific party according to a predetermined criterion, before the specific message May be displayed before the previous message displayed in the dialog window. In addition, the specific message may be displayed before the previous message on the screen of the at least one specific counterpart terminal that transmits and receives a message to each other when the message is relocated as described above. As a result, the user can change the order of the messages according to the content of the message, thereby allowing the conversation contents to be grasped at a glance, and the convenience of using the mobile terminal can be improved.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
4 is a control flowchart of a mobile terminal according to an embodiment of the present invention.
5 is a diagram illustrating an example of a method of operating a mobile terminal when a user inputs a message relocation command in a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 6 shows an example of a mode in which a placement location of a message input after a plurality of question messages are received in the mobile terminal according to an exemplary embodiment of the present invention is determined.
FIG. 7 shows an example of a form in which the process of FIG. 6 is performed on the other party's terminal.
FIG. 8 shows an example of a mode in which a location of an answer message is determined when another message is received while an answer message is being generated in a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 9 shows another example of a mode in which a location of an answer message is determined when another message is received during an answer message in a mobile terminal according to an embodiment of the present invention.
FIG. 10 shows an example of a method in which a location where a message to be transmitted through a scroll in a mobile terminal is determined according to an embodiment of the present invention.
FIG. 11 shows an example in which an answer recommendation function is applied in a mobile terminal according to an embodiment of the present invention.
FIG. 12 shows an example of a function that can be performed through a message that can be edited by all the conversation participants in the mobile terminal according to an embodiment of the present invention.
13 is a block diagram of a mobile terminal for implementing an embodiment of the present invention.
14 is a block diagram of a message transmission / reception server according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation.

However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 located on the front, rear, or side of the mobile terminal 100, and a touch sensor (static / static) 137. Although not shown, ), A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

In the case where the display unit 151 and the touch sensor 137 have a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device . The touch sensor 137 may be stacked on the display unit 151 to form a layer structure when the touch sensor 137 has a form of a touch film, a touch sheet, a touch pad, or the like. And may be integrally formed.

The touch sensor 137 may be configured to convert a change in a pressure applied to a specific part of the display part 151 or a capacitance generated in a specific part of the display part 151 into an electrical input signal. The touch sensor 137 can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor 137, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

A program for processing and controlling the controller 180 may be stored in the memory 160 and temporary storage of data input / output (e.g., telephone directory, message, audio, still image, For example. The memory 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

A part such as a USIM card and a memory card, which is required to be detached, such as an auxiliary storage medium 165, may include an opening in the case so that the part can be inserted into the case from the outside. Slots may be formed on the side of the case so that the auxiliary storage medium 165 may be inserted from the side of the mobile terminal 100 and card slots 166 and 167 may be formed on the surface of the rear case 102 It is possible.

The cases 101, 102, and 103 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131, 132, and 133. The operation units 131, 132, and 133 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive commands such as activation / deactivation of the touch recognition mode of the display unit 151 and the like.

The operation units 131, 132 and 133 may have a button system recognized when a user applies pressure and a touch sensor 137 may be provided to the operation units 131, 132 and 133 in addition to the display unit 151 So that the user's command can be received only by the user's touch.

3 is a rear perspective view of the mobile terminal shown in FIG.

Referring to FIG. 3, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body such that they can be rotated or pop-up.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output 152 'on the rear side of the body may implement the stereo function together with the sound output 152 (see FIG. 2) of the front side of the body, and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

Change message layout according to condition satisfaction

Hereinafter, various embodiments of a control method that can be implemented in the mobile terminal configured as above will be described.

For convenience of explanation, it is assumed that the mobile terminal referred to below includes at least a part of the components shown in Fig. Specifically, the mobile terminal according to the present embodiment essentially includes a wireless communication unit 112, a display unit 151, and a control unit 180 among the components shown in FIG. Since the mobile terminal according to the present invention can be more easily implemented when the display unit 151 is a touch screen, it is assumed that the display unit 151 is a 'touch screen' in the following description and drawings.

In addition, the below-mentioned message may include a short message service (SMS) or a long message service (LMS) message or a multimedia message service (MMS) message. Further, embodiments of the present invention described below can be applied to any type of received data that requires user confirmation, such as (instant) instant messenger applications or e-mail, as well as messages.

According to an embodiment of the present invention, a mobile terminal transmits and receives a message to and from a counterpart via a wireless communication unit, and a touch screen displays a message transmitted or received by a specific counterpart. Preferably, the message to be transmitted and received can be displayed through a dialog window formed with a specific party. Only messages exchanged with the specific party may be included in the dialog window. Each message displayed on the dialog window may be given a predetermined visual effect so that the message transmitted by the mobile terminal user and the message received from the specific counterpart are visually distinguished.

In this case, the user can access the dialog box by selecting one message item in the other party-based message list. The other party-based message list may include at least one message item corresponding to at least one other party. If there are a plurality of messages received from a specific counterpart, the plurality of messages constitute one chat window, and one message item corresponding to the chat window is generated. If one of the message items of the counterpart-based message list is selected, the dialog window screen can be accessed.

The specific counterpart may be one or more than one. When there are a plurality of specific counterparts, the specific counterparts may be composed of one group. One dialog window may be formed for the one group, and the dialog window may include all the messages transmitted by the members of the group, and the messages transmitted by the respective members may be displayed to all the other members.

In one embodiment of the present invention, when one or more first messages are received, which are requested by the user, among the messages input by the other party in the dialog window, the second message corresponding to the answer to each received first message When the message is input / transmitted, the controller 180 recognizes the corresponding situation and displays a second message corresponding to a location where the first specific message is displayed (i.e., changes the placement position) without any additional operation by the user. Of course, the controller 180 may determine that the message is a first message if a message having a content matching the content of the message is input from the user, even if the message is not explicitly requested, The position of the input second message can be determined and changed.

FIG. 4 shows a control flowchart of a mobile terminal according to an embodiment of the present invention.

As shown in FIG. 4, the wireless communication unit sequentially receives at least one first message from a specific party, and the controller may display the received at least one first message in order of reception time (S410).

At this time, if the second message is inputted from the user, the controller 180 may determine whether the predetermined batch change condition is satisfied (S420). Here, the predetermined batch change condition may be a condition for determining whether the first message received is matched with the second message input by the user, and may be a condition for inputting a message relocation instruction of the user, The first message according to the situation recognition, and the automatic relocation according to the second message determination. In addition, the controller 180 may determine the first message to be matched with the second message by considering the time at which the second message is input to the first message, the association between the contents of the first message and the second message, Process, which will be described in more detail below.

The control unit 180 may determine the placement position of the second message on the dialog so as to correspond to a condition satisfied by the second message among the predetermined batch change conditions (S430).

Accordingly, the controller 180 may cause the second message to be displayed at the determined placement position (S440). In addition, the control unit 180 may transmit the second message to the terminal of the other party participating in the dialog box together with information on the determined placement position. At this time, the information on the arrangement position and the second message can be transmitted to the terminal of the other party through a specific server that manages and relays information on the dialog box.

On the other hand, if the batch change condition is not satisfied (i.e., the first message matching the second message is not determined), the controller 180 displays the second message on the dialog window according to the general rule, The second message can be transmitted (S460). Here, the general rule may mean that a message is displayed in one direction according to the transmission / reception time order, and more specifically, it may be displayed immediately below the message last displayed at the time of message input / transmission.

First, referring to FIG. 5, a case where a user directly inputs a relocation command to change the position of a second message will be described.

More specifically, as shown in (1) of FIG. 5, a touch screen 151 of the user's mobile terminal 100 displays a plurality of messages 21 To 24 may be displayed. The messages 21 to 24 are displayed in order of transmission time.

As shown in (2) of FIG. 5, in a state that the messages 21 to 24 transmitted and received in the dialog window are displayed in the order of transmission, the user can touch one message 24 with a long touch. Then, the touch drag input can be continuously performed. At this time, the user may terminate the touch drag input on another message (22). In response to the successive long touch and touch drag commands, the control unit recognizes the message (24) in which the long touch input has been performed as a second message, and transmits the message (22) overlapped with the end point of the touch drag input Message.

In the state where both the first message and the second message are displayed as described above, a message relocation command for the second message may be input. The message relocation command may be input from a user via a touch screen. In this case, the message relocation command may be a touch input of a specific pattern. Alternatively, the message relocation command may be received from outside the mobile terminal. The message relocation command may be delivered from one of the terminals of the one or more particular parties, or may be delivered from a message server.

The control unit can rearrange and display the second message before the first message when the message relocation command is input. That is, the second message displayed after the first message may be rearranged such that it is displayed before the first message. As a result, the order of the messages displayed on the touch screen of the mobile terminal can be changed.

For example, the control unit may recognize one of the messages displayed on the touch screen as the relocation command, the touch drag input being successively performed after a long touch. The continuous long touch and touch drag input may also be processed as a user command specifying the first message and the second message as described above. In this case, the user can select a message (second message) to be rearranged by one touch input and a position (first message) where the message is to be rearranged, and issue a message rearrangement command.

Specifically, the control unit can recognize the long touch and touch drag input performed in (2) of Fig. 5 as a relocation instruction. In response thereto, the control unit can relocate the second message 24 such that the selected second message 24 is displayed before the first message 22, as shown in (3) of FIG. The second message 24 is displayed before the first message 22, although it is later than the first message 22. [

As shown in (3) of FIG. 5, when the order of messages displayed by the message rearrangement command is changed, the controller can control the rearranged message 24 to be distinguished from other messages. For example, as shown in (3) of FIG. 5, the control unit can control the touch screen so that a highlight effect is given to the edge of the second message 24.

At the same time, when the message rearrangement command is input, the controller may control the wireless communication unit to transmit the rearrangement command of the second message to the terminal of the one or more specific parties.

The wireless communication unit may transmit the message relocation command directly to the terminal of the other party, or may transmit the message relocation command to the message server. When the message relocation command is transmitted to the message server, the message server can transmit the message relocation command to the other party's terminal.

The message relocation command may control the other party's terminal so that the second message is rearranged and displayed before the first message at the other party's terminal. That is, the control unit of the terminal of the one or more specific counterparts can rearrange the second message before the first message and display the messages according to the rearranged order as the message rearrangement command is received. As a result, the order of the messages displayed on the other party's terminal can be changed as well.

Next, with reference to FIG. 6, a description will be given of a mode in which a placement position of a second message inputted by a user is determined when a plurality of first messages requesting a user's answer exist.

FIG. 6 shows an example of a mode in which a placement location of a message input after a plurality of question messages are received in the mobile terminal according to an exemplary embodiment of the present invention is determined. That is, it is assumed that the predetermined batch change condition is a case where a plurality of question messages are successively received. In FIG. 6, it is assumed that a dialog window in which the terminal user B exchanges messages with the counterpart A is displayed on the touch screen.

First, after the first inquiry message 201 is received from the other party as shown in FIG. 6 (1), the second inquiry message 202 may be received before the user B transmits the answer message to the user B. In this case, when the user inputs a message as shown in (2) of FIG. 6, the controller 180 detects a question mark in each of the received messages before the user inputs a message, The first message). Accordingly, the control unit 180 detects that there is time-related information (i.e., "3 o'clock") in the message entered by the user, and the message is an answer to the first message 201 It can be displayed above the second message even if it is later than the second message 202 as shown in (3) of FIG. 6. If the answer entered by the user includes a word related to the place, the answer message may be displayed under the second message 202.

On the other hand, the situation of FIG. 6 can be displayed as shown in FIG. FIG. 7 shows an example of a form in which the process of FIG. 6 is performed on the other party's terminal.

First, FIG. 7 (1) shows a state in which two messages 201 ', 202' are sequentially input onto the touch screen 151 'of the terminal 100' of the counterpart A, respectively. Here, when the user B inputs a reply message for the first message 201 ', the reply message 220' is also displayed on the touch screen of the partner A as shown in (2) of FIG. 7 as the first message 201 ' Message 202 '. This is because not only the second message but also information on the placement position is received together with the terminal of the counterpart A

Next, with reference to FIGS. 8 and 9, a case where another message is received while an answer to the arrived message is received will be described.

FIG. 8 shows an example of a mode in which a location of an answer message is determined when another message is received while an answer message is being generated in a mobile terminal according to an exemplary embodiment of the present invention.

Referring to (1) of FIG. 8, a corresponding message may be displayed on the dialog window on the touch screen 151 of the mobile terminal 100 as the message 201 is received from the counterpart A side. In this case, when the user of the mobile terminal inputs a response message to the received message 201 through the message input window 240, the controller 180 transmits a signal indicating that the message is being created to the other party And transmits it to the mobile terminal (server when passing the server). Accordingly, on the touch screen 151 'of the mobile terminal 100' of the other party, as shown in (2) of FIG. 8, the information 230 'indicating that the user B is composing a reply message is displayed under the first message 201' Can be displayed. Of course, as shown in (3) of FIG. 8, the information 230 indicating that the user B is composing a reply message may also be displayed on the touch screen 151 of the user. In this state, when the opposite party A again inputs the second question through the message input window 240 'and then transmits the same, the information 230 indicating that the user B is composing the answer message as shown in (3) A second question message 202 may be displayed. If the user inputs a transmission command for the message being created, the controller 180 determines whether the corresponding message is an answer to the first message 201. If it is determined that the message is an answer, the controller 180 generates a response message The information 230 indicating that the answer message is being generated as shown in (4) of FIG. 8 can be transmitted to the counterpart terminal together with the arrangement position information indicating that the answer message is displayed at the position where the information 230 indicating the information 230 is displayed. May be replaced by an answer message (220).

In the case where each message is relayed through the server, the server assigns message number 2 to the information indicating that the answer is being created, processes it as a temporary message, inserts the contents of the response message into the temporary message when the answer is inputted, So that the above-described process can be performed. That is, the message number 1 is assigned to the first question message 201, the message number 3 is assigned to the second question message 202, and if the user stops composing the answer and the input window 240 ), The server can delete the description of the message number 2. If the user subsequently enters a message again, the server can assign message number 4 to the re-entered message. Of course, when the location information is transmitted from the mobile terminal 100 together, the server can allocate an appropriate message number according to the location information. This case will be described with reference to Fig.

FIG. 9 shows another example of a mode in which a location of an answer message is determined when another message is received during an answer message in a mobile terminal according to an embodiment of the present invention.

9 (1), there is a situation similar to (3) in FIG. 8, but instead a situation in which a message entered by the user into the input window 240 is not related to either of the two received messages 201 and 202 Respectively. Of course, information 230 'indicating that an answer is being created may be displayed on the touch screen of the other party's terminal as shown in (2) of FIG.

In this case, when a transmission command for the created message is input to the message window 240, if the controller 180 determines that there is no relation between the context of the created message and the two previously received messages, To the other terminal. Accordingly, as shown in (3) of FIG. 9, the information 230 indicating that the answer is being created disappears in the dialog window displayed on the touch screen 151, and the message 250 created by the user is displayed after the received messages . Of course, also in the other terminal, the information 230 'indicating that the answer is being created disappears as shown in (4) of FIG. 9, and a message 250 () created by the user is displayed after the transmitted message. Of course, this function can also be implemented by user's explicit command input. For example, when the user inputs a message after touching the input window twice, the control unit 180 may omit the placement position information regardless of the contents of the message when the input message is transmitted.

6 to 9, the controller 180 has determined the first message by a method of detecting a question mark. However, this is an example. Even if a symbol is missed, it is determined whether or not the message includes a questionnaire (when, It can be determined whether or not the message is a first message requiring an answer through the other context.

Next, with reference to FIG. 10, a method for the user to scroll through the first message corresponding to the second message will be described.

FIG. 10 shows an example of a method in which a location where a message to be transmitted through a scroll in a mobile terminal is determined according to an embodiment of the present invention.

In Fig. 10 (1), a situation similar to (1) in Fig. 6 is assumed. Here, when the user scrolls down the dialog window through the touch input using the pointer 400, a message designation indicator 310 may be displayed at the center of the dialog window as shown in FIG. 10 (2). The user can scroll through the message designation indicator 310 to locate the message to be answered. For example, if the user wants to transmit a reply message to the first message 201, the user can scroll the dialog window in the same state as in FIG. 10 (3). When the user inputs a message and then transmits the message, the controller 180 generates location information to display a message transmitted after the first message, and transmits the message to the counterpart terminal. Accordingly, a message 220 created as shown in FIG. 10 (4) may be displayed between the first message 201 and the second message 202. Also, the function may be realized such that the user designates the gaze of the user using the camera 121 instead of scrolling, and the message designation indicator is moved corresponding to the user's gaze. In this case, the message designation indicator may be displayed when the user inputs a specific command (for example, a long touch on the dialog window) or when it is determined that a plurality of messages requiring an answer are received.

According to another aspect of this embodiment, this function can be applied even when the control unit 180 grasps the context of the received message and recommends an answer to be transmitted. This will be described with reference to FIG.

11 shows an example of a case where an answer recommendation function is applied in a mobile terminal according to another embodiment of the present invention.

Referring to FIG. 11 (1), as the message 206 is received from the other party, the controller 180 grasps the context of the received message and stores information, which can be an answer requested by the other party, For example, the Internet, a cloud service, etc.). The recommendation answer 510 corresponding thereto can be displayed at the bottom of the dialog window. Here, if the user selects 'x', the recommendation answer 510 may disappear from the dialog window, and if an area excluding 'x' is selected from the recommendation answer, the recommendation answer may be transmitted as a message. In this situation, if a second message 207 is received, which is requested by the user as shown in (2) of FIG. 11, the control unit 180 also searches for a recommendation answer 520 for the second message and displays it on the dialog . Here, when the user selects the first recommendation answer 510, a message 290 corresponding to the recommendation answer may be displayed between the first message 206 and the second message 207 as shown in (3) of FIG. 11 .

According to still another aspect of the present invention, a user can display a message that can be edited by another party participating in a conversation in the conversation window. This will be described with reference to FIG. FIG. 12 shows an example of a function that can be performed through a message that can be edited by all the conversation participants in the mobile terminal according to an embodiment of the present invention.

Referring to (1) of FIG. 12, a group dialogue is performed in three dialog boxes, namely, the user C and the two parties A.B. Here, it is assumed that three messages (601 to 603) are received from two parties in the current dialog, but more messages have been previously transmitted and received. At this time, a message window 610 can be generated as shown in (2) of FIG. 12 as a user applies a specific pattern touch input (for example, a long touch) to a free area of the dialog window. The message entered by the user into the input window 240 may then be displayed in the generated message window 610. Here, the message window 610 may display the information of the user who created the message window together. In this situation, the opposite party B can select a message window 610 'displayed on the touch screen 151' of his / her mobile terminal 100 'and input the answer message as shown in (3) of FIG. Accordingly, the message window 610 displayed on the screen of the user C can be replaced with the message 620 inputted by the counterpart B as shown in (4) of FIG. At the same time, when the keyword included in the replaced message 620 is included in the previously displayed message, predetermined visual effects 631 and 632 may be given to each keyword in the message. Therefore, the above-described method may be particularly useful for judging the contents of the conversation at once if the user does not input a message for a predetermined time or confirm the dialog in the conversation window.

Hereinafter, a specific configuration of a mobile terminal and a server for implementing the above-described embodiments with reference to FIG. 13 and FIG. 14 will be described.

FIG. 13 shows a block diagram of a mobile terminal 100 according to an embodiment of the present invention. As shown in FIG. 17, the mobile terminal 100 may include a wireless communication unit 110, a display unit 151, and a control unit 180. The controller 180 may include a message display unit 181a, a message input unit 181b, and a message buffer management unit 181. The message display unit 181a, the message input unit 181b, and the message buffer management unit 181 may be connected to the wireless communication unit 110, .

The message receiver 112a receives a message from another mobile terminal or a message transmission / reception server. The message receiving unit 112a receiving the message can convert the received message into a data format used by the message buffer managing unit 181 and transmit the converted data to the message buffer managing unit 181. [

On the other hand, the message input unit 181b converts data, such as text and images, input by the user as a message on the display unit 151 into a data format used by the message buffer management unit 181 and transmits the data format to the message buffer management unit 181 have. In addition, the message input unit 181b can transmit a message relocation instruction inputted through the display unit 151 to the message buffer management unit 181. [

The message buffer management unit 181 may receive a message from the message input unit 181b and determine whether to relocate the second message according to a predetermined condition. If message placement location information is delivered with the message, it may decide to perform relocation. The message buffer management unit 181 analyzes the message relocation command and can change the serial number (i.e., message number) assigned to each message according to the message relocation command.

The serial number or the message number is a number indicating the order in which each message is displayed. As described above, the serial number or the message number can basically be given to each message in the order of transmission and reception of the message. Specifically, the message buffer management unit 181 may rearrange the serial numbers of the first and second messages after the first message, and may assign a serial number of the previous message to the second message .

The message buffer management unit 181 can deliver the messages having the changed serial number to the message display unit 181a. The message display unit 181a interprets the received message as a message to be displayed to the actual user, and can display the message in the order of the message serial number.

In addition, the message buffer management unit 181 may transmit the batch position information received from the message input unit to the message transmission unit 112b. The message transmitting unit 112b transmits the message arrangement position information to the other mobile terminal and the message transmission / reception server.

FIG. 14 shows a block diagram of a message transmission / reception server 900 according to an embodiment of the present invention. As shown in FIG. 18, the message transmission / reception server 900 can transmit a plurality of messages between the first mobile terminal and the second mobile terminal, and further includes a message receiver 911a And a message transmission unit 911b for transmitting, to the second mobile terminal, placement position information for causing the second mobile terminal to rearrange and display the plurality of messages differently from the time order in which the plurality of messages are transmitted and received, according to the received control signal .

In addition, the message transmission / reception server 900 may include a dialog window management unit 910, a first message buffer management unit 912-1, a second message buffer management unit 912-2, and the like. Each message buffer management unit controls mobile stations sharing a dialogue window, and can store messages transmitted and received between mobile stations. In this description, the first mobile terminal and the second mobile terminal can be controlled through the first message buffer management section 912-1.

The message receiving unit 911a may convert the message transmitted by the first mobile terminal into a data format used by the message buffer managing unit and transmit the message to the dialogue window managing unit 919. [ At the same time, the message receiver 911a can receive the message relocation command from the first mobile terminal and deliver it to the dialog window manager 910. [

The dialog window management unit 910 can classify the message so that the message delivered from the message reception unit 911a can be delivered to the message buffer management unit to which the first mobile terminal belongs and transmit the message to the corresponding message buffer management unit. In this example, the message transmitted from the first mobile terminal may be delivered to the first message buffer management unit 912-1. At the same time, the dialog window management unit can also transmit the arrangement position information to the first message buffer management unit 912-1.

The first message buffer management unit 912-1 may change the serial number of messages stored in the process of being transmitted / received between the first mobile terminal and the second mobile terminal, based on the received message arrangement location information. Since the description of the serial number is the same as that described above, it will be omitted.

After changing the serial number of the messages, the first message buffer management unit 912-1 transmits the message and the layout position information transmitted by the first mobile terminal to the dialog window management unit 910 again, and the dialog window management unit 910 And can transmit the message and the arrangement position information to the message transmission unit 911b. The message transmitter 911b may transmit the cultivation location information together with the received message to the second mobile terminal.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (15)

A wireless communication unit for transmitting / receiving a message to / from one or more specific parties;
A touch screen for displaying a plurality of first messages among a plurality of messages received through the wireless communication unit; And
Determining whether the second message is matched with each of the plurality of first messages if the second message is input after displaying the plurality of first messages, and transmitting the second message to a specific one of the plurality of first messages To be displayed at a corresponding position,
And a control unit for controlling the wireless communication unit to transmit, to the terminal of the at least one specific counterpart, placement position information for causing the terminal of the at least one specific counterpart to display the second message at a position corresponding to the specific message terminal. The method according to claim 1,
Wherein the plurality of first messages include a message for which a user's response is required. 3. The method of claim 2,
Wherein,
Recognizes the plurality of first messages through at least one of whether or not a specific punctuation code is included, whether or not a question is included, and context recognition. The method according to claim 1,
The location corresponding to the specific message may be,
And a location immediately below said specific message. The method according to claim 1,
Wherein the matching is performed using the plurality of first messages and the relevance of words included in the second message. The method according to claim 1,
Wherein the plurality of first messages comprises:
Wherein the mobile terminal is received before the second message is transmitted after the mobile terminal last transmitted the message to the at least one specific party. The method according to claim 1,
Wherein the matching is performed according to a relative positional relationship between the indicator displayed on the touch screen and the plurality of first messages. 8. The method of claim 7,
Further comprising a camera for capturing an image including a user's image,
Wherein the control unit changes the position of the indicator using a change in the line of sight of the user photographed through the camera. 8. The method of claim 7,
Wherein,
Controls the indicator to be displayed at a fixed position on the touch screen, and controls the plurality of first messages to move according to a scroll command. 3. The method of claim 2,
Wherein,
Displays a recommendation reply for each message for which the user is required to reply in one area on the touch screen and recognizes the answer selected from the user among the recommended answers as the second message. Receiving a first answer request message and a second answer request message from one of the at least one specific party;
Displaying the first response request message and the second response request message according to a reception order;
Receiving an answer message;
Determining whether the first and second answer request messages are matched with the input answer message;
Determining and displaying a location where the answer message is displayed according to the matching; And
And transmitting information on the determined position to the at least one specific counterpart with the answer message. 12. The method of claim 11,
The step of determining and displaying the position comprises:
If the first response request message matches the first response request message, the response message is displayed adjacent to the first response request message,
And if the second response request message matches the second response request message, the response message is displayed adjacent to the second response request message. 12. The method of claim 11,
The step of determining and displaying the position comprises:
And controlling the display unit to display the answer message after the last transmitted or received message when the matching answer request message does not exist. A message transmission / reception server for transmitting a plurality of messages between a first mobile terminal and a second mobile terminal, and storing the plurality of messages,
A message receiver for receiving a transmission message and location information from the first mobile terminal; And
Wherein the second mobile terminal is configured to transmit the transmission message and the placement position information to the second mobile terminal so that the transmission message is displayed at a position corresponding to the placement position information, regardless of a time order in which the plurality of messages are transmitted / And a message transmitter for transmitting the message to the second mobile terminal. Instructions for sending and receiving messages with one or more specific parties;
Instructions for displaying a plurality of first messages received from the one or more specific parties;
Determining whether the first message is matched with each of the plurality of first messages if the second message is input;
And displaying the second message at a position corresponding to a specific one of the plurality of first messages according to the determination result; And
And transmitting, to the terminal of the at least one specific counterpart via the wireless communication unit, placement position information for causing the terminal of the at least one specific counterpart to display the second message at a position corresponding to the specific message, Lt; / RTI >

Images